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This volume contains ten chapters on numerical methods which could be 
gainfully employed by scientists and engineers to solve the problems arising 
in research and industry. It also covers the syllabus prescribed for engineering 
studies at the undergraduate level An essential feature of the present edition 
is that it provides information about the readily available computer program 
packages for implementing the numerical methods described in the book. 
These include references to MAT LAB, 1MSL and Numerical Recipes program 
libraries. Several problems have been set as exercises to illustrate the use 
of these libraries, Nevertheless* for a better understanding of these methods, 
the readers are advised to develop their own programs in any computer 
language of theiT choice, 

More than two decades have elapsed since the first appearance of this 
book and* quite naturally* there have been many changes in the presentation 
of the material as also new additions of topics to meet the changing 
requirements of students in various universities. Thus, topics like curve 
fitting procedures, cubic spline methods, approximation of functions, numerical 
solution of integral equations, Graeffe’s root-squaring method, weighted 
least-squares approximations, B-splines, Householder and QR methods, singular 
value decomposition, shooting method, the ADI method and the finite element 
method were gradually added to enhance the utility of the book. In the 
present edition, most sections have been rewritten to provide a better 
understanding of the topics. Thus the section, on cubic splines has been 
rewritten with the inclusion of Linear and quadratic splines, and a new 
section on surface fitting by cubic splines has been added. Similarly, a new 
section on Fourier transforms has also been included. The worked examples 
have been modified* new problems have been introduced and the number of 
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worked examples and homework problems has been significantly increased. 
This edition therefore contains about 500 problems including the illustrative 
examples and exercises for homework. Answers have been provided to 
some selected end-of-chapter exercises. 

The author is very much obliged to the students and teachers of various 
universities who have been using this book during the last several years, 
Grateful thanks are due to Prof I. Chandra Mohan, SH Venkateswara University, 
Tirupatu for bis suggestion to derive the general formulae in predictor- 
corrector methods in Chapter 7. Any suggestions towards the improve¬ 
ment of the book will be gratefully accepted. Special thanks are due to 
Sri Asoke K_ Ghosh, Chairman and Managing Director, Prentice-Hall of India, 
New Delhi, for his courteous cooperation in bringing out this edition. 


Chennai SS. SASTRY 

February, 2005 
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CHAPTER 


Errors in Numerical Calculations 

■ I I I'II I' II1I MMI I II I I1WI M III I > WI 


1.1 INTRODUCTION 

In practical app I leaf tens, an engineer would finally obtain results in a numerical 
form. For example* from a set of tabulated data derived from an experiment, 
inferences may have to be drawn; or, a system of linear algebraic equations 
is to be solved. The aim of numerical analysis is to provide efficient methods 
for obtaining numerical answers to such problems. This book deals with 
methods of numerical analysts rather than the analysts of numerical methods, 
because our main concern is to provide computer-oriented* efficient and 
reliable numerical methods for solving problems arising in different areas of 
higher mathematics. The areas of numerical mathematics, addressed in this 
boot, are: 

(a) Algebraic and transcendental equations: Hie problem of solving 
nonlinear equations of the type /(x) = 0 is frequently encountered 
in engineering. For example, ihe equation 

^0 - gfr+rtfrfrn (in 

is a nonlinear equation for t when M Q ,g t u,UQ and w/ are given. 
Equations of this type occur in rocket studies. 

(b) Interpolation: Given a set of data values y,) s i = 0* 1, 2,,..*n* of 
a function y - f{x\ where the explicit nature of fix) is not known, 
it is often required to find the value of y for a given value of x, 
where x 0 < x This process is called interpolation . If this process 
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is carried out for functions of several variables, it is called multivariate 
interpolation. 


(c) Curve fitting: This is a special case where the data points are 
subject to errors, both round off and systematic. In such a case, 
interpolation formulae yield unsatisfactory solutions. Experimental 
results are often subject to errors and, in such cases, the method 
is to fit a curve which passes through the data points and then use 
the curve to predict the intermediate values. This problem is usually 
referred to as data smoothing. 


(d) Numerical differentiation and integration: It is often required to 
determine the numerical values of 

2 

(i) for a certain value of x in iq <,x ^ and 




where the set of data values (**, y,) t i - 0,1 is given, but the 
explicit nature Qfy(x) is not known. For example, if the data consist 
of the angle 8 (in radians) of a rotating rod for values of time r (in 
seconds), then its angular velocity and angular acceleration at any 
time can be computed by numerical differentiation formulae. 

(e) Matrices and linear systems: The problem of solving systems of 
linear algebraic equations and the determination of eigenvalues and 
eigenvectors of matrices are major problems of disciplines such as 
differentia! equations, fluid mechanics, theory of structures, etc. 

(f) Ordinary and partial differential equations: Engineering problems 
are often formulated in terms of an ordinary or a partial differential 
equation. For example, the mathematical formulation of a falling 
body involves an ordinary differential equation and the problem of 
determining the steady-state distribution of temperature on a heated 
plate is formulated in terms of a partial differential equation. In 
most cases, exact solutions are not possible and a numerical method 
has to be adopted. In addition to the finite difference methods, this 
book also presents a brief introduction to the finite element method 
for solving partial differential equations. 

(g) Integral equations: An equation in which the unknown function 
appears under the integral Sign IS known as an integral equation . 
Equations of this type occur in several areas of higher mathematics 
such as aerodynamics, elasticity, electrostatics, etc. A short account 
of some well-known methods is given. 

In the numerical solution of problems, we usually start with some 
initial data and then compute, after some intermediate steps, the 
final results. The given numerical data are only approximate because 
they may be true to two, three or more figures. In addition, the 
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methods used may also be approximate and therefore the error in 
a computed result may be due to the errors in the data, or the 
errors in the method, or both. In Section 1,3, we discus* some 
basic ideas concerning errors and their analyses, since such an 
understanding is essential for an effective use of numerical methods. 
Before discussing about errors in computations, we shall first look 
into some important computer languages and software. 

1.1.1 Computer and Numerical Software 

It is well known that computers and mathematics are two important tools 
of numerical methods, Prior to 1950, numerical methods could only be 
implemented by manual computations, but the rapid technological advances 
resulted in the production of computing machines which are faster, economical 
and smaller in size. Today’s engineers have access to several types of 
computing systems, viz,, mainframe computers, personal computers and 
super computers. Of these, the personal computer is a smaller machine 
which is useful, less expensive and, as the name implies, can easily be 
possessed and used by individuals. Nevertheless, mere possession of a 
computer is not of great consequence; it can be used effectively only by 
providing suitable instructions to it. These instructions are known as software. 
It is therefore imperative that we develop suitable software for an effective 
implementation of numerical methods on computers. 

Essentially, there are three phases in the development of numerical 
software for solving a problem. In the first phase, the problem to be solved 
must be formulated mathematically indicating the input and outputs and also 
the checks to be made on the solution. The second phase consists of 
choosing an algorithm, i.e., a suitable numerical procedure to solve the 
mathematical problem. An algorithm is a set of instructions leading to the 
solution of the mathematical problem, and also contains information regarding 
the accuracy required and computation of error in the solution. In the final 
phase, the algorithm must be transformed into a computer program (called 
code) which is a set of step-by-step instructions to the computer written 
in a computer language. Usually, it may be preferable to prepare a flowchart 
first and then transform the flowchart into a computer program, The flowchart 
consists of the step-by-step procedures, in block form, which the computer 
will follow and which can easily be understood by others who wish to 
know about the program. It is easy to see that the flowchart enables a 
programmer to develop a quality computer program using one of the computer 
languages listed in the next section. However, experienced programmers 
often transform a detailed algorithm into an efficient computer program. 

1.1.2 Computer Languages 

Several computer languages have so far been developed and there are limitations 
on every language. The question of preferring a particular language over 
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others depends on the problem and its requirements. We list below some 
important problem-solving languages, which are currently in use: 

(a) FORTRAN: Standing for FORmula TRANslation, FORTRAN was 
introduced by IBM in 1957, Since then, it has undergone many 
changes and the present version* called FORTRAN 90, is favoured 
by most scientists and engineers. It is readily available on almost 
all computers and one of its important features is that it allows a 
programmer to express the mathematical algorithm more precisely. It 
has special features like extended double precision, special mathematical 
functions and complex variables. Besides, FORTRAN is the language 
used in numerically oriented subprograms developed by many software 
libraries. For example, (IMSL) (International Mathematical and 
Statistical Library* Inc.) consists of FORTRAN subroutines and 
functions in applied mathematics. Statistics and special functions, 
FORTRAN programs are also available in the book. Numeral Recipes , 
published by the Cambridge University Press, for most of the standard 
numerical methods. 

(b) C; This is a high-level programming language developed by Bell 
Telephone Laboratories in 1972- Presently, it is being taught at 
several engineering colleges as the first computer language and is 
therefore used by a large number of engineers and scientists. Computer 
programs in C for standard numerical methods are available in the 
book, Numerical Recipes in C, published by the Cambridge University 
Press, 

(c) BASIC; Originally developed by John Kemeny and Thomas Kurtz 
in 1960, BASIC was used in the first few years only for instruction 
purposes. Over the years* it has grown tremendously and the present 
version is called Visual Basic. One of its important applications is 
in the development of software on personal computers, ft is easy 
to use, 

1.1.3 Software Packages 

It is well known that the programming effort is considerably reduced by 
using standard functions and subroutines. Several software packages for 
numerical methods are available in the form of "functions" and these are 
being extensively used by engineering students. One such package is MATLAB, 
standing for MATrices LA Boratory- It was developed by Cleve Moler and John 
N + Little. As the name implies, it was originally founded to develop a matrix 
package but now it incorporates several numerical methods such as root- 
finding of polynomials* cubic spline interpolation, discrete Fourier transforms, 
numerical differentiation and integration, ordinary differential equations and 
eigenvalue problems. Besides, MATLAB has excellent display capabilities 
which can be used in the case of two-dimensional problems, Using the 
MATLAB functions, it is possible to implement most of the numerical methods 
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on personal computers and hence it has become one of the most 
popular packages in most laboratories and technical colleges. MATLAB has 
its own programming language and this is described in detail in the text by 
Stephen J. Chapman * 

1.2 MATHEMATICAL PRELIMINARIES 

In this section we state, without proof, certain mathematical results which 
would be useful in the sequel. 

Theorem 1.1 If f(x) is continuous in a£x£b, and if /(a) and /(b) are 
of opposite signs, then /(£) = 0 for at least one number 4 such that a < 4 < &■ 

Theorem hi (Rolle's theorem) If f(x) is continuous in a<x<,b> /'(*) 
exists in a < x < b and f{o) - /(b) = 0, then, there exists at least one value 
of x, say #, such that f\4 ) = 0, a < 4 < b. 

Theorem I.J (Generalized Rolk's theorem) Let /(jc> be a function which 
is n times differentiable on [a T bJ. If f(x) vanishes at the (n + I) distinct 
points xq, in (a, b), then there exists a number 4 in (a* b) such that 

/"’in=0. 

Theorem L4 (Intermediate value theorem) Let f(x) be continuous in 
[a, b\ and let k be any number between f(a) and f(b ). Then there exists 
a number ( in (o T b) such that /(£)-£ (see Fig. 1.1). 



Flguw 1.1 

Theorem 1.5 {Mean-value theorem for derivatives) lf/(x) is continuous 
in [a. b] and f’{x ) exists in (o. b), lien there exists at least one value of 
x* say 4 , between a and b such that 

<?) , a <t<b. 

b-a 

♦Published by Thomson Asia Pie. Ltd.. Singapore (2002). 
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Setting b-a + h, this theorem takes the Form 

f(a + h)- f{a) + hT(a + &h% Q<6< 1. 

Theorem 1.6 (Taylor* s series for a junction of one variable) If f ft) is 
continuous and possesses continuous derivatives of order n in an interval 
that includes x = a, then in that interval 

/(*)=/(«)+(*-«>Ao)+“^ /»■+% z ^/ (n '‘W K, (-0, 

2! (n-1)! 

where R m (x\ the remainder term , can be expressed in the form 

a<i<x. 


Theorem 1.7 {MadaurirTs expansion) It states 

m = m +*/ r (0)+ ^-rm +••■+• • 


2! 


n\ 


Theorem 1.8 (Taylor's series for a function of two variables) It stales 

Bf Bf 

f(x\ + Ax h x 2 + At 2 ) = /(X],* 2 ) + —At] +—Ax 2 

ratj cx 2 


1 

+ - 

2 




l ' &,&2 1 4 &| 


This can easily be generalized. 

Theorem L9 (Taylor's senes for a function of several variables) 
f(x y +Ax yi x 2 + Ax 2 ^* r x„ +Ax„) 

. *n)+^te t + ^Ax l + '- + ^bx n 

6*1 V*! dx fT 


1 

+— 

2 


§(M) 2 +.+ ^(AJj 1 +2r^-Ax l d Jl + 

as: arf ftr, &r 2 


+ 2 - 
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13 ERRORS AND THEIR COMPUTATIONS 

There are two kinds of numbers, exact and approximate numbers. Examples 
of exact numbers are 1*2*3, 1/2*3/2, e, etc,, written in this 

manner. Approximate numbers are those that represent the numbers to a 
certain degree of accuracy. Thus, an approximate value of x is 3.1416, or 
if we desire a better approximation, it is 3.14159265. But we cannot write 
the exact value of jt. 

The digits that are used to express a number are called significant digits 
or significant figures. Thus, the numbers 3.1416. 0,66667 and 4.0687 contain 
five significant digits each. The number 0.00023 has, however, only two 
significant digits, viz., 2 and 3, since the zeros serve only to fix the position 
of the decimal point. Similarly, the numbers 0.00145,0.000145 and 0.0000145 all 
have three significant digits. In case of ambiguity, the scientific notation should 
be used. For example, in the number 25 h 600> the number of significant figures 
is uncertain, whereas the numbers 2,56^IQ 4 ,2,560xlQ 4 and 2.5600* 1G 4 
have three, four and five significant digits, respectively. 

In numerical computations, we come across numbers which have large 
number of digits and it will be necessary to cut them to a usuable number of 
figures. This process is called rounding off. It is usual to round-off numbers 
according to the following rule: 

To round-off a number to n significant digits, discard all digits 
to the right of the nth digit, and if this discarded number is 

(a) less than half a unit in the nth place, leave the nth digit unaltered; 

(b) greater than half a unit in the nth place, increase the nth digit by 
unity; 

(c) exactly half a unit in the nth place, increase the nth digit by unity 
if it is odd; otherwise, leave it unchanged. 

The number thus rounded-off is said to be correct to n significant 

figures. 

Example 1A The numbers given below are rounded-off to four significant 
figures: 

1.6583 to 1.658 

30.0567 to 30.06 
0.359378 to 0.S594 

3,14159 to 3.142 

In hand computations, the round-off error can be reduced by carrying 
out the computations to more significant figures at each step of the 
computation. A useful Tule is: at each step of the computation, retain at least 
one more significant figure than that given in the data, perform the last 
operation and then round-off. However, most computers allow more number 
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of significant figures than are usually required in engineering computations. 
Thus, there are computers which allow a precision of seven significant 
figures in the range of about 10" Jfi to 10 3? . Arithmetic carried out with this 
precision is called single precision arithmetic, and several computers implement 
double precision arithmetic, which could be used in problems requiring 
greater accuracy. Usually, the double precision arithmetic is carried out to 
15 decimals with a range of about 10 _JQ * to 10*°®. In MATLAB, there is a 
provision to use double precision arithmetic. 

In addition to the round-off error discussed above* there is another type 
of error which can be caused by using approximate formulae in computations, 
—such as the one that arises when a truncated infinite series is used. This 
type of error is called truncation error and its study is naturally associated 
with the problem of convergence. Truncation error in a problem can be 
evaluated and we are often required to make it as small as possible. Sections I A 
and 1.5 will be devoted to a discussion of these errors. 

Absolute, relative and percentage Errors 

Absolute error is the numerical difference between the true value of a 
quantity and its approximate value. Thus, if X is the true value of a quantity 
and X\ is its approximate value, then the absolute error E A is given by 

E a = X-Xi =dX. (1.2) 

The relative error is defined by 

F - ^ A (1 3) 

£r -T’T* () 

and the percentage error (£ P ) by 

£ P = 100£ R . (1,4) 

Let AX be a number such that 

|X,-Jr[£AJf. (1.5) 

Then AX is an upper limit on the magnitude of the absolute error and is 
said to measure absolute accuracy. Similarly, the quantity 

AX AX 

i*i V, i 

measures the relative accuracy. 

It is easy to deduce that if two numbers are added or subtracted, then 
the magnitude of the absolute error in the result is the sum of the magnitudes 
of the absolute errors in the two numbers. More generally, If £ e\ J 

are the absolute errors in n numbers, then the magnitude of the absolute 
error in their sum is given by 

|£] 1 I+|eJ|+...+| j b;|. 
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Note: While adding up several numbers of different absolute accuracies, the 
foil owing procedure may be adopted: 

(i) Isolate the number with the greatest absolute error, 

(ti) Round-off all other numbers retaining in them one digit more than 
in the isolated number, 

(iii) Add up, and 

(iv) Round-off the sum by discarding one digit. 

To find the absolute error, £ Ajt in a product of two numbers a and b t 
we write E A = (a + + E A )-where E l A and E A are the absolute 

errors in a and b respectively. Thus* 

E A = aE\+bE ] A + E l A Ei 

- bE A + uE A , approxirnately (1.6} 

Similarly, the absolute error in the quotient alb is given by 

“+*A a «a—E* 
b+El 6~ Hb+El) 


b 2 (i*E 2 A !b) 

bE^ -aE\ , 

---, assuming that E^tb is small in comparison with 1 


b a b 


(1.7) 


Example 1.2 If the number X is rounded to N decimal places, then 

AX = i{10^), 

2 

If jy = 0.51 and is correct to 2 decimal places, then ilX -0,005, and the 
relative accuracy is given by 0.005/0.51 = 0.98%, 

Example L3 An approximate value of jt is given by X x =22/7=3.1428571 
and its true value is X — 3,1415926. Find the absolute and relative errors. 
We h a v e 

£ a =JT-J f, =-0.0012645 
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and 


£ ft = 


-0.0012645 

3.141592ft 


= -0.000402. 


Example 1.4 Three approximate values of the number 1/3 are given as 
0.30, 0.33 and 0.34, Which of these three is the best approximation? We have 



0.01 i 
3 300* 



0.02 _ 1 
3 = 150' 


It follows that 0.33 is the best approximation for 1/3. 

Example L5 Find the relative error of the number 8.6 if both of its digits 
are correct. 

Here 


Hence 


£ a = 0,05 


£*= — = 0.0058. 

8.6 


Example L6 Evaluate the sum S = v |f 3 + ./5 + to 4 significant digits 
and find its absolute and relative errors. 

We have 

^3 = 1.732, /5 = 2.236 and = 2.646 
Hence S = 6,614. Then 


E a = 0.0005 + 0.0005 + 0.0005 ^ 0.0015 
The total absolute error shows that the sum is correct to 3 significant 
figures only. Hence we take S' = 6.61 and then 




0.0015 

6,61 


= 0 . 0002 . 


Example L7 Sum the following numbers: 

QJ532, 15.45, 0.000354, 305.1, 8.12, 143.3, 0.0212, 0.643 and 0.1734. 
where in each of which all the given digits are correct. 

Here we have two numbers which have the greatest absolute error. 
These are 305.1 and 143.1 and the absolute error in both these is 0.05. 
Hence, we round-off all the other number to two decimal digits. These are: 
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0.15, 15.45, 0.00, 8.12, 0.02, 0.64 and 0.17. 

The Sum S is given by 

S = 305 . I +143.3 + 0.15 +15.45 + 0.00 + 8.12 + 0.02 + 0.64 + 0.17 
* 472.59 
= 472.6 

To determine the absolute error, we note that the first-two numbers have 
each an absolute error of 0.05 and the remaining seven numbers have an 
absolute error of 0.005 each. Thus the absolute error in all the 9 numbers is 

£ a = 2(0,05) + 7(0.005) 

-0.1 + 0 035 
- 0.135 


= 0.14 

In addition to the above absolute error, we have to take into account the 
rounding error in the above and this is 0,01 > Hence the total absolute error 
is $ - 0.14+0-01 = 0.15. Thus, 

5 = 47245 ±0.15. 

Example L8 Two numbers are given as 2.5 and 48,289, both of which 
being correct to the significant figures given. Find their product. 

Here the number with the greatest absolute error is 2.5. Hence we 
round-off the second number to three significant digits, i.e, 48.3. Their 
product is given by 

P = 48.3 * 2,5 = 120.75 = 1 > 2 * 10 2 , 

where we have retained only two significant digits since one of the given 
numbers, viz,, 2.5, contained only two significant digits. 

1*4 A GENERAL ERROR FORMULA 

In this section, we derive a general formula for the error committed in using 
a certain formula or a functional relation. Let 

— 0*&) 

be a function of several variables (i = | p % *and let the error in each 
Xji be Ax r Then the error An in u is given by 

u + Au = f( j£| + Ax t , x 2 + Ax*,..., x n + Ax„). (1,9) 

Expanding the right-hand-side by Taylor's series (see Theorem 1.9), we 
obtain 
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■jr 

u + da = /(*!, *„) + ^ — Axy + terms involving (AXj) 2 . (1 JO) 

/-I “if 

Assuming that the errors in x, are small and that (Ax, )fx t « I, so that 
the squares and higher powers of can be neglected, the above relation 
yields 


Ai# a? V —Ax, = — Ajcj + Ajc, +-■■ + —Ax 
feaxi * dx y ' dxi 1 dx n n 


¥ 


% 


(1 11 ) 


We observe that this formula has the same form as that for the total differential 
of u. The formula for the relative error follows immediately; 


g _ Au _ du Axi + du A *2 + + du Ax n 


8x\ U 6^2 U &x n 

The following example illustrates the use of this formula. 
Example L9 Let u = 5xy 2 fz*. 

Then 

■l 


0 - 12 ) 


ctu _ 5 y du _ \Qxy du I5xy 


2 


dx 




and 


Sy 2 lOxy 

s &y - 7 


& 


i w 


As 


In general, the errors A*, Ay and Az may be positive or negative, and 
hence we take the absolute values of the terms on the right side. This gives 


(A*) n 


5/ 


Ax 


Wxy. 
—* y 


15^ 


■Ax 


Now, let Ax - Ay - Az ~ 0.001 and x - y = z = 1. Then, the relative maximum 
error (^h)^ is given by 


<£rW~™ = ~=°0<»- 


1.5 ERROR IN A SERIES APPROXIMATION 

The truncation error committed in a series approximation can be evaluated 
by using Taylor*s series stated in Theorem 1.6. If x, and x j4 a are two 
successive values of x, then we have 
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/(iw)=/(*i)+U + 1- (1 13) 

where 

^l(^l)- ^ *,<£<*», (1.14) 

In (1J3), the last term, ik+ifo+iX is called the remainder term which, 
for a convergent series, tends to zero as n Thus, if /(x^ + |) Is 
approximated by the First-** terms of the series (LI 3), then the maximum error 
committed by using this approximation (called the nth order approximation) 
i$ given by the remainder term (x /+l ). Conversely, if the accuracy required 
is specified in advance, then it would be possible to find u, the number of 
terms, such that the finite series yields the required accuracy. 

Defining the interval length 

x i +] —■*# —A, (1^5) 

Eq r (IJ3) may be written as 

/(* W )= /U,)+V’(r ( ) + ^/"(jf / ) + '- + ^/" i (* i )+0(r’ 1 ), (1.16) 

2! n\ 

where 0(h n+l ) means that the truncation error is of the order of /i** 3 , ije» 
it is proportional to b fl+! . The meaning of this statement will be made dearer 
now. 

Let the series be truncated after the first term. This gives the zero-order 
approximation: 

(1.17) 

which means that halving the interval length h will also halve the error in 
the approximate solution. Similarly, the first-order Taylor series approximation 
is given by 

/(*,.!)= fO ,)+ ¥'(x ,) + 0(A : X 0-18) 

which means that halving the interval length, h will quarter the error in the 
approximation. In such a case we say that approximation has a second-order 
of convergence. We illustrate these facts through numerical examples. 

Example EIQ Evalute /(!} using Thy lor's series for f(x), where 

it is easily seen that /(!) = -? but it will be instructive to see how the 
Taylor series approximations of orders 0 to 3 improve the accuracy of /(l) 
gradually. 
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Let pih — l, jCjj — 0 and jc /+1 -L We then require The derivatives 

off fa} are given by 

/'<*) = 3^ -6* + 5, f\x)-6x-6, /'"(*)*■ 6, 
f"{x) and higher derivatives being ail zero. Hence 

/'(iji./W-S, f\x,)-fXO)- -6, /'"(0)=6. 

Also, 


io- 

Hence, Taylor’s series gives 

/(*,♦])=A*)+¥’<*,)+y/”(*,)+y)■ 0) 

From Ci>, the zero-order approximation Is given by 

/(%l) = /(*) +0(A), 00 

and therefore 

/(l) = /{®)+ □(*)*-10, 

the error in which is -7 + 10, i.e. 3 units. 

For the first approximation, we have 

nx M )=Ax l )+IT(x l )+oi^), 08 ) 

and therefore 

/0) = -10+5+O(A( 1 )»-5, 

the error in which is -7+5, i.e. -2 units. 

Again, the second-order TayJor approximation is given by 

A**l) - A*i) +¥'(*,)+ y/"W + O (hh 0v) 


and therefore 


/(lJ^-LO+S + if-^+OCft 3 )®-^ 

m which the error is -7 + 8, i.e. 1 unit* 

Finally, the tMrd^order Taylor series approximation is given by 

- ft*,) + V*W+y/”W+y/’», M 
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and therefore 


/to= m +*/{*>)+v/"<*>) +~rx*o 3 

»^lO+S+i{-6) + i<6) 

= -7, 

which is the exact value of/(L)* 

This example demonstrates that if the given function is a polynomial of 
third degree, then its third-order Taylor series approximation gives exact 
results. 


Example Ell Given / (x) sin x. construct the Taylor series approximations 
of orders 0 to 7 at x = xB and state their absolute errOTS. 


Let j f+l = ff/3 and ^ = x/6 so that h = jt/3 - x/6 = x/6. We then have 



Since /(i) = sinjr J eq, (1) becomes: 



The different orders of approximation can now be evaluated successively. 
Thus, the zero-order approximation is 0.5; the first-order approximation Is 
0.5+ff/3/I2, i.e. 0J53449841; and the second-order approximation is 


0.5 + 


xjz 

12 


x 


1 


144’ 
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which simplifies to 0.884910921* Similarly* the successive approximations 
are evaluated and the respective absolute errors can be calculated since the 
exact value of sin (?r/3) is 0J66Q254Q3. Table ],1 gives the approximate 
values of sin (ff/3) for the orders 0 to 7 as also the absolute errors in these 
approximations. The results show that the error decreases with an increase 
in the order of approximation. 


Table 1.1 Taylor Series Approximations of - sin x 


Order d approximation 

Computed value of aifi *73 

Absolute error 

0 

0,S 

0,366025403 

1 

0,953449841 

0,087424438 

2 

0,884910921 

0.016885618 

a 

0*664191613 

0,00183379 

4 

0.S65757474 

0.000267929 

5 

0.36604143 

0,000016067 

§ 

0.86602713 

0,000001777 

7 

0,866025326 

0.000000077 


We next demonstrate the effect of halving the interval length on any approximate 
value. For this, we consider the first-order approximation in the form: 

fix + A) = f{x) + hf{x}+£(h), (ii) 

where E{h) is the absolute error of the first-order approximation with interval 
kicking /(x)=sinx and x = &/6* we obtain 

sln^ + Aj = sin^+^cos^ + £{/i). (hi) 

Putting h = fri (i in (iiij, we get 

silt- = 0,5 + + E(k) = 0,953449841 + E(h). 

3 12 

Since sin (jt/ 3) = 0.866025403. the above equation gives 

E(h) = -0,08742443 8, 

Now, let the interval be halved so that we now take h = ff/12. Then, (iii) gives: 



where E{hi2) is the absolute error with interval length ht. 2. Since 
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equation (iv) gives: 





= -0.019618139, 


and then 


—- 4,45630633, 
E(U 2) 


In a similar way* we obtain the values 


M$—L = 4.263856931 
E(hli) 


and 


mm 

£(hm 


4.141353027. 


The Jr -order of convergence i$ quite revealing in the above results. 
Example U2 The Maclaurin expansion for e* is given by 




rt-l 


e J =l + i+^4+*.4 

2! 3! («~1)! it 




0 < £ < jr. 


We shall find it, the number of terms, such that their sum yields the value 
of correct to R decimal places at x * 1, 

Clearly* the error term (i.e. the remainder term) is (jt'Vn!)^* so that 
at £ = x this gives the rnaxi/mun absolute error, and hence the maximum 
relative error is x'Vn? For an 8 decimal accuracy at x = 1 we must have 

nl 2 

which gives n = l2. Thus, we need to tahe 12 terms of the exponential 
series in order that its sum is correct to 8 decimal places. 


EXERCISES 


1*1, Round-off the following numbers to- two decimal places: 

48.21416, 2.3742, 52.275, 2375. 2.385, SL255, 

L2. Round-off the following numbers to four significant figures: 

38.46235, 0.70029, 0.0022218, 19.235101, 236425 
1.3* Calculate the value of 102 - ^/lOl correct to four significant figures. 
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1*4* If ti = 3v 7 -6v, find file percentage error in u at v = 1, if the error 
in v b 0.05. 

1.5, Define the term absolute error. Given that 

o = 10.00 ±0.05 
6 = 0,0356 ±0.0002 
c-15300 ±100 
d = 62000 ± 500, 

find the maximum value of the absolute error in 
(a) a+h + c + d (b) a + Sc-d and (c) c^. 

1.6* Obtain the range of values within which the exact value of 

1.265(10.31-7.54) 

47 

lies, if all the numerical quantities are rounded-off. 

1*7. What is meant by absolute and relative errors? If 

0.3 1jc +2.73 
y ~ i+CJS 1 

where the coefficients are rounded-off, find the absolute and relative 
errors in y when jr = 0.5 ±0.1. 

L& Find the sum of the numbers 105.5, 27.25, 6.56, €.1568, 0.000256, 
208.6, 0.0235, 0.538 and 0.0571, where each number is correct to 
the digits given. Estimate the absolute error in the sum. 

1.9* Find the product of the numbers 56.54 and 12.4 which are both 
correct to the significant digits given. 

1.10. Find the quotient q = xIy f where x = 4.S36 and y - 1.32, both x and 
y being correct to the digits given. Find also the relative error in the 
result, 

1*11* Prove that the relative error of a product of three non-zero numbers 
does not exceed the sunt of the relative errors of the given numbers. 

LI2, Find the number of terms of the exponential series such that their 
sum gives the value of correct to five decimal places for all 
values of x in the range 

L13, The function f{x) ~ taiT l x can be expanded as 

J JS> 2n-i 

tan _1 x = x-—+ --”■ +(-1)H--+.*, 

3 5 w 2n-l 

Find n such that the series determines tan" 1 1 correct to eight significant 
digits. 
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1.14. Derive the series 


log. 



x? X 5 

X + — + — 

3 5 



and use it to compute the value of log, (1*2) correct to seven decimal 
places, Determine the number of terms required if the series for 
log, (1 +jc) were used instead. 

1.15. Write down the Taylor series expansion of /(r) - cos x at x-xf 3 
in terms of /(x) and its derivatives at x = jt/ 4. Compute the 
approximations from the zero-order to the fifth order and also state 
the absolute error in each case. 

1.16. The Madaurin expansion of sin x is given by 

X 1 X s x 7 

stn Jf b|“ — +-- — + ■■, 

3! 51 71 

where x is in radians. Use the series to compute the value of sin 25* 
with an accuracy of 0.00 L 
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Solution of Algebraic and 
Transcendental Equations 


2,1 INTRODUCTION 

In scientific and engineering studies, a frequently occurring problem is to 
find the roots of equations of the form 

/(*) = ()♦ ( 2 . 1 ) 

If /(x) is a quadratic, cubic or a biquadratic expression, then algebraic 
formulae are available for expressing the roots in terms of the coefficients. 
On the otherhand, when f(x) is a polynomial of higher degree or an expression 
involving transcendental functions, algebraic methods are not available, and 
recourse must be taken to find the roots by approximate methods. 

This chapter is concerned with the description of several numerical 
methods for the solution of equations of the form (2J) T where /(x) is 
algebraic or transcendental or a combination of both. Now, algebraic functions 
of the form 

f H (r) = a$x n + a, x^ 1 + a 2 x n ~ 1 + ■ ■ + ^_jjc + a n , (2 + 2) 

are called polynomials and we discuss some special methods for determining 
their roots. A non-algebraic function is called a transcendental function, 
e g > /(x) = In i 3 — 0*7* &x) = e* 5z -Sx , i^(x) = sin 2 x- x 1 -2, etc. The 
roots of (2.1) may be either real or complex. We discuss methods of finding 
a real root of algebraic or transcendental equations and also methods of 
determining all real and complex roots of polynomials. Solution of systems 
of nonlinear equations will be considered at the end of the chapter. 
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2.2 THE BISECTION METHOD 

This method is based on Theorem l.l which slates that if a function /(x) 
is continuous between a and b„ and /(a) and f(b) arc of opposite signs, 
then there exists at least one root between a and b. For definiteness, let /(a) 
be negative and f{b) be positive. Then the root lies between a and b and 
let its approximate value be given by xy -(« + b)f2. If f{x§}- 0, we conclude 
that % is a root of the equation /(x)» 0* Otherwise, the root lies either 
between x& and fr, or between % and a depending on whether /{.v„> is 
negative or positive. We designate this new interval as [a lf frj] whose length 
is As before, this Is bisected at x 3 and the new interval will be 

exactly half the length of the previous one. We repeat this process until the 
latest interval (which contains the root) is as small as desired, say c. It is 
clear that the interval width is reduced by a factor of one-half at each step 
and at the end of the nth step, the new interval will be of length 

\b - 4Q", We then have 


which gives on simplification 

(2 3) 

log, 2 

Inequality (2.3) gives the number of iterations required to achieve an accuracy 
e. For example, if \b-a\=\ and £*0.001, then it can be seen that 

nSHO (2-4) 

The method Is shown graphically in Fig. 2.1. 



Figure 2.1 Graphical representation of bisection method. 

It should be noted that this method always succeeds. If there are more 
roots than one in the interval bisection method finds one of the roots. It 
can be easily programmed using the following computational steps: 
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1, Choose two real numbers a and h such that f{d)f{b)< 0, 

% Set i r = (a + b)/2. 

3. (a) If f{a) f{x r )<Q. the root lies in the interval (a f jc,). Then, set 
b-x f and go to step 2 above, 

(b) If /{a) /(je r ) > 0 P the root lies in the interval fjCj., *), Then, set 
a =x r and go to step 2. 

(c) If f{a) f{x r }~ 0, it means that x r is a root of the equation 
/(*) = 0 and the computation may be terminated. 

In practical problems, the roots may not be exact so that condition (c) 
above is never satisfied. In such a case, we need to adopt a criterion for 
deciding when to terminate the computations. 

A convenient criterion is to compute the percentage error e F defined by 


St = 






(2.5) 


where ,x' is the new value of The computations can be terminated when e r 
becomes less than a prescribed tolerance, say s r in addition, the maximum 
number of iterations may also be specified in advance, 

Example 2J Find a real root of the equation /(jc) = jc 3 -x -1 = 0. 

Since /(l) is negative and /(2) positive, a root lies between I and 2 
and therefore we lake 3 $ = 3^2. Then 

f(i n \ =^Z _ ^.-11 which is positive. 

^ 8 2 8 + 

Hence the root lies between 1 and 1.5 and we obtain 

1 + 1.5 


*1 = 


= 1,25 


We find /(jt,) = -19/64, which is negative, We therefore conclude that the 
root lies between 1,25 and 1,5. If follows that 

1.25 + 1.5 , _ 

*3 =-5— =1-375 

The procedure is repeated and the successive approximations are 
x 3 = 1,3125, x 4 = 1,34375, x * = 1,328135 T etc. 

Example 2*2 Find a real root of the equation x 3 - 2jc-5 = G. 

Let f(x) = t* - 2x - 5, Then 

/(2) = -I and /(3) = 16. 

Hence a root lies between 2 and 3 and we take 
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Since /(%) = 5.6250, we choose (2, 2.5] as the new interval. Then 
Xl = 2+11 = 2.25 and f{x % ) = 1.890625 
Proceeding in this way* the following table is obtained. 


n 

a 

b 

X 

/(JO 

1 

2 

3 

2.5 

5.6250 

2 

2 

2.5 

2 25 

1.8905 

3 

2 

2.25 

2.125 

0,3457 

4 

2 

£.125 

2.0625 

-0.3513 

5 

20625 

£125 

209375 

-0,0009 

6 

2.09375 

£125 

2.10938 

0.1660 

7 

2.09375 

2.1093® 

2.10156 

0,07856 

8 

2.09375 

2.10158 

2.09768 

0,03471 

9 

£.09375 

2.09756 

£.09570 

0.01286 

10 

209375 

2.09570 

£09473 

0,00195 

If 

2.09375 

2.09473 

2.09424 

-0.0035 

tz 

2.09424 

2.09473 




At n ~ 12, it is seen that the difference between two successive iterates is 
0.0005, which is less than 0.001. Thus this result agrees with condition 
given in (2.4). 

Example 2.3 Find a positive root of the equation xe x - 1, which lies 
between 0 and 1. 

Let /(jc) = xe* -1. Since /(Q) = “I and /(I) = L7I8, it follows that a 
root lies between 0 and 1. Thus* =0,5, Since/(0.5) is negative, it follows 
that the root lies between 0,5 and I. Hence the new root is 0.75, i.e., 
jf| =0.75. Using the values of and we calculate : 


= 


*1 "*iQ 
x i 


n. 100 = 33,33%. 


Again, we find that /(0.75) is positive and hence the root lies between o,5 
and 0.75, i.e. *2 = 0.625. Now, the error is 



0.625 - 0,75 
0.625 


x 100 = 20%. 


Proceeding in this way + the following table is constructed where only the 
sign of the function value is indicated. The prescribed tolerance is 0,05%. 
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Sign of 


Lie ml 

a 



f(*f) 

E f (%) 

1 

0 

1 

0.5 

negative 

— 

2 

0.6 

t 

0.75 

positive 

33.33 

3 

as 

0.7S 

0.625 

positive 

20.00 

4 

0.5 

0.625 

0.5625 

negative 

11,11 

5 

Q.S625 

0.625 

0.59375 

positive 

5.263 

6 

0.5625 

0.59675 

05781 

positive 

2707 

7 

0.5625 

0,5781 

0.5703 

positive 

1.368 

6 

0.5625 

0.5703 

0.5664 

negative 

0.688 

9 

0,5664 

0,5703 

0.5684 

positive 

0352 

10 

0.5664 

0,5684 

0.5674 

positive 

0.176 

11 

0,5664 

0,5674 

0.5669 

negative 

0.668 

12 

0.5669 

0 5674 

0.5671 

negative 

0036 


Thus, after 12 iterations, the error, e r , finally satisfies the prescribed tolerance, 
viz,, 0,05%, Hence the required root is 0,567 and it is easily seen that this 
valve is correct to three decimal places. 


23 the method of false position 


This is the oldest method for finding the real root of a nonlinear equation 
f(x) - 0 and closely resembles the bisection method. In this method, also 
known as regain falsi or the method of chords, we choose two points a and 
b such that f(a) and /(A) are of opposite signs. Hence, a root must lie in 
between these points. Now, the equation of the chord joining the two points 
[a, /(a)] and [b, f{b)] is given by 

y-m m-m (2 . 6 > 

i-n b-a 

The method consists in replacing the part of the curve between the points 
[a, /(d)] and [6, /(A)] by means of the chord joining these points, and 
taking the point of intersection of the chord with the x-axis as an approximation 
to the root. The point of intersection in the present case is obtained by 
putting y — 0 in (2.6), Thus, we obtain 




m 

m-m 


0 -«) 


af{b)-bf{d) 

m-m ’ 


(2,7) 


which is th * first approximation to the root of f(x) = 0. If now /(.t l ) and 
f(a) are of opposite signs, then the root lies between a and jtj, and we 
replace b by in (2.7), and obtain the mxt approximation. Otherwise, we 
replace a by x, and generate the next approximation. The procedure is 
repeated till the root is obtained to the desired accuracy. Figure 2.2 gives 
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a graphical representation of the method. The error criterion (2,5) can be 
used in this case also. 



Figure 22 Method or false position 
Example 2,4 Find a real root of the equation : 

f(x} = f-2x-S = Q. 


We find /(2) = -l and /(3)=16. Hence a -% 3, and a root lies 

between 2 and 3, Equation (2,7) gives 


x \ 


2(16) -3(-l) 
16-i-l) 


-2.05SS23529. 

17 


Now, f{x |) = -0.390799917 and hence the root lies between 2 058823529 and 
3.0. Using formula (2.7), we obtain 


2.058823529(16) - 3(-0.390799917) 
] 6,390799917 


= 2.08126366, 


Since f{x 2 ) = -0,147204057, it follows that the root lies between 2.08126366 
and 3.0. Hence, we have 


i 3 = 


2.08126366(8 6) - 3 (-0.147204057) 
16.147204057 


-2.089639211. 


Proceeding in this way, we obtain successively: 

r 4 = 2,092739575, = 2,0938837 ], 

jc 6 -2 094305452* * 7 = 2,094460846, , .. 

The correct value is 2.0945,,,, so that x? Is correct to five significant 
figures. 

Example 2.5 Given that the equation x 22 = 69 has a root between 5 and 8, 
Use the method of regula-falsi to determine it 

Let /(x) - x 2 - 2 - 69. We find 

/(5) = -34.50675846 and /{8) = 28.00586026, 
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Hence 


5(28,00586026) - S (-34.50675846) 
28,00586026 + 34.50675846 


- 6,655990062, 


Now, /(^) - -4.275625415 and therefore, the root lies between 6.655990G62 
and 8,0. We obtain 


x 2 = 6,83400179, ij =6.850669653, 

The correct root is 6,8523651..** so that x 3 is correct to three significant 
figures. 


2,4 THE ITERATION METHOD 

We have so far discussed root-finding methods, which require the interval 
in which the root lies. We now describe methods which require one or more 
starting values of x. These values need not necessarily bracket the root. The 
first is the iteration method, which requires one starting value of jc. 

To describe this method for finding the roots of the equation 

/U) = 0* (2,1) 

we rewrite this equation in the form 

r = #(*). (2.8) 

There are many ways of doing this. For example, the equation 

jc 3 + jc 2 -1=0 

can be expressed as either of the forms: 

-0-* 3 ) 1 ' 2 , 

Let rg, be an approximate value of the desired root Substituting it for x 
on the right side of (2.8), we obtain the first approximation 

*i =#Uo> 

The successive approximations are then given by 

*2 “ ( x lX " H*2 fc*“* )■ 

A number of questions now arise: 

(i) Does the sequence of approximations Xq r x l f .,., x H t always converge 
to some number 

(ii) If it does* will £ be a root of the equation x = $(x)? 

(iil) How should we choose # in order that the sequence 
converges to the root? 

The answer to the fust question is negative. As an example, we consider 
the equation 

j = 10*+1. 
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[f we take = 0, x ( = 2, x 2 ^ 101, jc 3 = 10 101 +1, etc., and as n fncreases, x„ 
increases without limit. Hence, the sequence x^, x t , x^, x fl does not 
always converge and, in Theorem 2 1 below, we state the conditions which 
are sufficient for the convergence of the sequence. 

The second question is easy to answer, for consider the equation 

<2*9) 

which gives the relation between the approximations at the nth and (w + I)th 
stages. As n increases, the left side lends to the root & and if ^ is continuous 
the right side tends to ?$(£). Hence, in the limit, we have £ = #(£) which 
shows that £ is a root of the equation x = ^(x). 

The answer to the third question is contained in the following theorem: 


Theorem 2J Let x=4 be a root of /(x) = 0 and let / be an interval 
containing the point x = £, Let ^(x) and # r (x) be continuous in /, where 
^(x) is defined by the equation x = #(x) which is equivalent to /(x)=0. 
Then if | ft (x) | <1 for all x in 4 the sequence of approximations x^ x ]t x^ 
x„ defined by (2.9) converges to the root provided that the initial 
approximation x Q is chosen in I. 

Proof Since £ is a root of the equation x = 4>(x), we have 


From (2.9), 


Subtraction gives 




X| =^(x 0 ) 




(2 JO) 
( 2 - 11 ) 


By using the mean value theorem (see Theorem 1.3), the right-hand side 


can be written as (f-x<i)^(£o), ^ < 

■£, Hence we obtain 



V 

V 

(2 12) 

Similarly we obtain 



4-x 2 ^(4-x l mitX 

Mjh 

V 

V 

jT 

(2.13) 


*2 

(2.14) 



(2.15) 

1 f we let 



\f(4i)\&*<h 

for all i 

(2-16) 
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then Eqs. (2J2H2-15) give 

l£-*i|£i|£-*bj, . 

which show that each successive approximation remains in / provided that 
the initial approximation is chosen in /. Now, multiplying Eqs. (2.12) to (2,15) 
and simplifying, we obtain 

=(£-( 2 - 17 ) 

Since !^'(£))|< £, the above equation becomes 

[£-*bl (2.18) 

As n^« s the right-hand side of (2.18) tends to zero, and it follows that 
tiie sequence of approximations ^ Xj,..converges to the root | if k< J. 
The method can be represented graphically as follows. By sketching the line 
y = x and the curve y - ^(x) and considering the way in which the 
approximations jr, are obtained, a geometrical significance of the method is 
obtained and this is shown in Figs, 2.3-2.6. 




Figure 2.4 \ f(x) \ < 1 but The process Is convergent tout the 

approximations oscillate about the exact value. 
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Figure 2,5 (!'(*) the process is divergent. 



Figure 2.5 | #{*) | >1; the process is divergent 

The root so obtained is unique. To prove this* let and be two roots of 
Eq, (2,8)* i.e. let ^ and g = ^{£ 3 ). Then we obtain 

III-&l-l#«i)-*tei)l=l^(>r)llli-lil, ?«(*.*> 

which further simplifies to 

ifi-&iiH#'to>i]»fc (2*19) 

Since |^ r (r?)|< I, it follows that § -4% t and hence the root is unique. 

Again, 

or 

which is positive* since in the interval /. This shows that the root 

obtained by this method is a simple root. 

To estimate the error of the approximate root obtained, we have 

!#-**] ,)|S*|*-Jfe4 

= *\Z-X„+X„-X n _ l \ 
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which gives 


k jt* 

—kj -*b I- (2,20) 

In general, the speed of the iteration depends on the value of t ; the 
smaller the value of k, the faster would be the convergence, lie is the 
specified accuracy, ft. if 

\4~x m \is r 

then formula (2,20) gives 

K“VilS“*. (1.21) 

which can he used to find the difference between two successive iterates 
necessary to achieve a specified accuracy. The following examples illustrate 
the application of this method. 

Example 2,6 Find a real root of the equation + x 1 -1 = 0 on the interval 

[G t 1] with an accuracy of 10 4 

To find this root, we rewrite the given equation in the form 


Thus 


and 


x = 


_J_ 

Jx + 1 


*<*)= 


] 

V x +1 ’ 



1 

(x + lf 2 




[CJ] 

Using (2.21) we then obtain 


= ™L = - «jt« o.l7678 < 0.2. 

2/1 




0,0001 x 0.8 
Q2 


= 0,0004, 


Hence when the absolute value of the difference does not exceed 0.0004, 
the required accuracy will be achieved and then the iteration can be terminated. 
Starting with jc 0 - 0.75, we obtain the following table; 


n X* + 1 ^1 = W x p + 1 

0 0.75 1,3228756 0.7559289 

1 0.7559268 1.3251146 0.7546517 

2 _0.7546517_1,3246326_0.7549263 
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At this stage, we find that 

I JWi - i = 0 7549263 - 0.7546517 - 0,0002746, 

which is less than 0.0004. The iteration is therefore terminated and the root 
to the required accuracy is 0.7549. 


Example 2.7 Find the root of the equation 2% = cos * + 3 correct to three 
decimal places. 

We rewrite the equation in the form 


jr = ^(cos jc + 3) ffl 

Z 

so that 

#(*)*= “(oos*+3>, 

and 


I #'<*)!= 


sin x 
2 


<1 


Hence the iteration method can be applied to the eq. (i) and we start with 
Xq = gf 2. The successive iterates are 

Xj = 1 S t jf2 = 1 535, xj = 1.518, 

x 4 = t .526, x s = 1,522, x 6 = 1.524, 

x-f - 1.523, Jfg =1,524. 


Hence we take the solution as 1,524 correct to three decimal places. 

Example 2.0 Use the method of iteration to find a positive root, between 
0 and 1, of the equation xe* - ]. 

Writing the equation in the form 


* = 0 ) 

We find that ^(x) = e~ x and so ^(x) = -e~ x , 

Hence j |J p (jc)| <1 for x < h which assures that die iterative process defined 
by the equation j n+l =#(*„) will be convergent. 

Starting with x 0 = 1, we find that the successive iterates are given by 


JC] =\ie = 0.3678794. 
Xj = 0.5004735, 
*0,5453957, 

* 7 =0.5601154, 
jg, =0.5648793, 


x 2 =0.6922006, 
x A = 0.6062435, 
% — 0,5796123* 
x s ~ 0.5711431, 
x m = 0.56S42E7, 
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x n -0,5664147, 
*,3 =05669089, 
j 15 = 0,5670679, 
Jt 17 =0.567119, 
* 19 =0.5671354, 


* 12 =0.5675566, 
x 14 = 0.5672762, 
j ]6 =0,567186, 
x l& =0.567157, 
x 2j j = 0,5671477. 


Acceleration of convergence: Aitken'$ A 1 -process 

From the relation 


\£-x*+iMt(g)-Hx n )\£k\4-xA k cl 
it is clear that the iteration method is linearly convergent. This slow rate of 
convergence can he accelerated by using Aitken's method, which is described 
below. 

Let Xj_ii be three successive approximations to the desired root 

x = % of the equation j = ^{jc). From Section 2,4, we know that 

4 — Xj — k(£ — i^_|), £ — jf| + j = — jq) 

Dividing, we obtain 

jz 5 = iz$z i 
f-* M £-*, ' 

which gives on simplification 




% =x fH 


* 1+1 


-2jc, +x 


f-l 


If we now define At, and A 2 ** by the relations 


Axj = x M - and A 2 x ( = A (A*,), 


then 


( 2 , 22 ) 


a 3 j,.i =4(4* m ) 

= A(^ -x M ) 

= te t -Ax i _ l 

= */+! -*,-(*,-*m) 

= *r+l - + *r-l - 

Hence {2.22) can be written in the simpler form 


f =*/+!" 


(A*i) 2 

A 2 Jt M 


which explains the term d J -process. 


(2.23) 


pv rights- 


Presented By: http://www.ebooksuit.com 



33 


Shciiun 2.5: Newttin-Raphson Method 

[n any numerical application. the values of (he following underlined 
quantities must be obtained. 


Ax, 

Ji + l 


AVi 


Example 2,9 


A% before, 


We consider again Example 2.7, vjz. T the equation 
1 „ 

x = - (3 + cos x) 

2 


*i*LS 




0,035 


*2=1.535 

-0,017 

-0.052 

jr 3 a 1.518 




Hence we obtain from Eq. (2/23) 


. tl = ].518- ^° - 17) - =1.524, 
-0.052 

which corresponds to six normal iterations. 


2,5 NEWTON-RAPHSON METHOD 


This method is generally used to improve the result obtained by one of the 
previous methods. Let xq be an approximate root of /(jt)= 4> and let 
jlj - ^ + A be the correct root so that /Uj) = 0. Expanding /(x^+h) by 
Taylor's senes, we obtain 


f(*o)+¥'0*)+—r(*o>+-=b 


Neglecting the second- and higher-order derivatives, we have 


which gives 




JM. 

fi*>y 
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A better approximation than x 0 is therefore given by x h where 




/(%) 

fX%Y 


Successive approximations are given by 


♦ Jffl+lN where 


^ji+i ” x >i 


fw 

f(x n y 


which is the Newton-Raphson formula, 

If we compare Eq. (2,24) with the relation 

of the iterative method [see Eq. (2.9)] we obtain 


which gives 




fix) 

fXxY 


*'(*) = 


mrx*) 

lfX*)f 


(224) 


(2.25) 


To examine the convergence we assume that /(*),/'(*) and /"{*) are 
continuous and bounded on any interval containing the root * = £ of the 
equation /{jc) = 0. If £ is a simple root, then f\x)* 0, Further since /’(x) 
is continuous, !/*{*) for some &>0 in a suitable neighbourhood of 
Within this neighbourhood we can select an interval such that | /(x) /"(r)| < e 2 
and this is possible since /{£}- 0 and since f(x) is continuously twice 
differentiable. Hence, Ln this interval we have 

I (2-2b) 

Therefore by Theorem 2,l, the Newton-Raphson formula (2.24) converges, 
provided that the initial approximation .v n is chosen sufficiently dose to 
When £ is a multiple toot, the Newton-Raphson method still converges but 
slowly. Convergence can, however, be made faster by modifying formula 
(2.24). This will be discussed later. 

To obtain die rate of convergence of the method, we note that f(%) = 0 
so that Taylor’s expansion gives 

/(*„>+<£ /■'(*„)+-=o. 

from which we obtain 


fM 

fXx„) 




» /u) 

fix,) 


(2.27) 
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From (2.24) and (2.27), we have 


* £ - 1 i x E\lf 

»*' < 2 (X " 0 /<*„) 

(2,28) 

Setting 


~ T ii ~ 

(2,29) 

Equation (2.28) gives 


2 " /*(£) 

(230) 


so that the Newton-Raphson process has a second-order or quadratic 
convergence. 

Geometrically, the method consists in replacing the part of the curve 
between the point [r^ /(*§)! and the r-axis by means of the tangent to the 
curve at the point, and is described graphically in Fig. 2.7. It can be used 
for solving both algebraic and transcendental equations and it can also be 
used when the roots are complex. 



Example 2J& Use the Newton-Raphson method to find a root of the 
equation x 3 - 2x - 5 - Q. 

Here /(jc) a jr 3 - lx — 5 and /*(*)=3* 1 ~2, Hence Eq. (2,24) gives; 


x *+\= x n 


3x^-2 


<i) 


Choosing x 0 =2, we obtain /(*q ) = * I and /'(Xpi^lO. Putting « = 0 in OX 
we obtain 


*i = 



= 2.1 
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Now, 

/(r,) = (2.1) 3 -2(2.1)-S = 0.061, 
and 

/'(*j)=3(2,]) 2 -2 = 11.23. 

Hence 


*2=2.1 


0.061 
] 1.23 


= 2.094568. 


This example demonstrates that Newton-Raphson method converges more 
rapidly than the methods described in the previous sections, since this 
requires fewer iterations to obtain a specified accuracy. But since two 
function evaluations are required for each iteration, Ne wton-Raphson method 
requires more computing time. 


Example 2 .11 Find a root of the equation x sin x + cos x = 0, 
We have 

/(*) = x sin x + cos x and /'(r) = jc cos x. 
The iteration formula is therefore 


^n+1 


^sm^ + cpg^ 

x„coss fl 


With the successive iterates are given below 


ft 

x« 


*11*1 

0 

3.1416 

-1.0 

28233 

1 

2 3233 

-0.0662 

2,7936 

2 

2.7986 

-0.0006 

27964 

3 

2.7984 

0,0 

2.7984 


Example 2*12 Find a real root of the equation x-e *, using the Newton- 
Raphson method. 

We write the equation in the form 


/(xy-xe 1 - 1-0 


Let ijjsl. Then 

^ 4 )-° 6093,7 


Now 


/{*,) = 0,3553424, and 7^) = 3.337012, 


(i) 
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so that 

Xt = 0.6839397- °- 3si3424 = 0.5774545. 
3337012 

Proceeding in this way, we obtain 

= 0.5672297 and x 4 = 0,5671433. 


Generalized Newton 's method 

If £ is a root of f(x) = 0 with multiplicity p T then the iteration formula 
corresponding to (2.24) is taken as 




/(*») 

/K) 1 


(231) 


which means that (l/ J p)/ , 0^ t ) is the slope of the straight line passing through 
and intersecting the *-axis at the point (jc fl+h 0). 

Equation (2.31) is called the generalised Newton'$ formula and reduces 
to (2.24) foip = I, Since £ is a root of fix )-0 with multiplicity p, it follows 
that | b also a root of /*(*) = () with multiplicity ip-1 ), of /"(*)-0 with 
multiplicity (p-2} t and so on. Hence the expressions 


*o-P 


/(*ho> 
f’i* o>' 


*o-(p-l) 


fixp) 

n*r 


J& 


-ip-2 ) 


n* o) 

rw 


must have the same value if there is a root with multiplicity p f provided that 
the initial approximation x Q is chosen sufficiently close to the root. 

Example 2. IS Find a double root of the equation f(x) - x 3 - x 2 -x +1 = 0. 


Choosing ^ = 0.8, we have 

f\x) = Jx 2 -2x-i, and /“( x) = 6x-2. 
With jC(j = 0,8, we obtain 

2 /W =os _2 0073 a 1.Q12, 

fW -(0.68) 

and 




/W 

ft**) 


(-0.68) 


1.043. 


The closeness of these values indicates that there is a double root near to 
unity. For the next approx imaticm, we choose jc| = ||I and obtain 

J| - 2“^-Ij 01 -0.0099=1.000l h 
/Ui) 

and 


=1.01-0.0099 = 1.0001 

rc*i> 
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We conclude therefore that there is a double root at * = l ,0001 which is 
sufficiently close to the actual root unity. 

On the other hand, if we apply Newton-Raphson method with x$ =0,8, 
we obtain 

jr, = 0.8 + 0.106 » 0.9h and x 2 =0.91 + 0,046 * 0,96. 

It is clear that the generalized Newton’s method converges more rapidly 
than the Newton-Raphson procedure. 

2,6 RAMANUJAN'S METHOD 

Srinivasa Ramanujan (1887-1920) described an iterative method* which 
can be used to determine the smallest root of the equation 

/<*) = 0, C2J) 

where f(x) is of the form 

f(x) - 1 - (tfj.t + ^x 2 + a^x* + «,/+■(2.32) 
For smaller values of x, we can write 

[l - (a^ + + ajjc 3, + a A x* + - jr 1 = ^ + + hjjr 2 + ■ - (2,33) 

Expanding the left-hand side by binomial theorem, we obtain 

1 + {a^x + fljr 1 + ajJt 3 +-) + (aiX + ct2X i + a i 3C i + ^ J f+^~bi+b2x + b^x 2 +*** 

( 2 , 34 ) 

Comparing the coefficients of like powers of x on both sides of (2,34), we 
get 


bi=U 

2 

^=h 3| + flj = a \b% + ^2^11 


(2,35) 


b H =d|h Jt _| + Qj&n-l n = 2,3,... J 

Without any proof, Ramanujan states that the successive cotwergents, 
viz., bjbn+ti approach a root of the equation /(x) « 0, where /(*) is given 
by (2.32). The following examples illustrate the application of this method. 

Example 2.14 Find the smallest root of the equation 

f{x )+ 1 lx-6-0. (i) 


•See Bemdt [1985], p.4l. 
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We have 


t- 


1Lt-6x 2 +t 3 T 


- ^ +i^jc + 63 x 2 +* 


<u) 


Here 


Hence, 


11 


*J=H *3^ 


4)= 1; 

. A 11. 

, , 121 . 85 

6, = ^ + ^,4, 

i>4 = +^*2 + d.j6| = —; 

= Gjfe* + 02^3 + + °4^\ - 


tJ4=as=”’=0 


3661 

1296; 


+ cJj+ £ 14^2 ^ ^5^ ~ 


22631 
7776 ' 


Therefore, 


*L = A = 0.54545 
h ii 

^ = — = G.7764705 
bi 85 

^- = — = 0.8869565 
6 4 115 

^- = ^2 = 0.9423654 
hs 3661 

*UliH = o,9706155 
bi 3233 

The smallest root of the given equation is unity and it can he seen that the 
successive convergents approach this root. 
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Example 2JS Find a root of die equation xe x = 1. 


Let *r T = 1 (i) 

Expanding g x in ascending powers of x and simplifying, we can rewrite 
eq. (i) as: 


2 X* J 3 

l-x + x +^+ — + — + <■** 

2 6 24 

which is of the form of the right side of Eq, (2J2), Here 


(ii) 


<h = *• &2=l 

We then have 





*1-1: 


- <*2 “ 1; 


+ ffjh| =1+1-2; 

l 7 

S 4 = -MJjfc, +«,6, = 2+1 + - = 

h = afa + n-a,^ +o 4 ^ = ^ + 2+“+^ »y! 

, . . . . 37 7 . 1 1 261 

h E ^5 + ^4 + a 3*3 + “~6~ + 2 + + 6 + 24 = ^j~* 


Therefore, 


£ = 1 = 0.5 
*) 2 

— = — = 0.5714 
^ 7 

£ = — = 0.56756756 
% 37 

^ = — ^0.56704980 
ifc 261 

It can be seen that Newton's method (see Example 2,12} gives the value 
0.5671433 to this root 

Example 2J6 Find a root of the equation suut^l-je. 

Using the expansion of sin x. the given equation may be written as 


•pyrighl 
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Hence we write 


x + t - 


£ £ 
31 + 5 ! 



Here 


1- 

f, ? 

2x - 


_£_ + Y 


6 

V 

+ 120 ” 

5040 ^^ 

/J 


-fy ^-bjX + hjX 2 +■■■ 


<^=2, q 1 - 0, flja 4 = 0, 

D 


*5« 


1 

120 ' 


We then obtain 


a 6 =0. 




l 

5040’"' 


*1= 1: 

fc2=fl] =2* 

fc,-4; 

*4 “ + a 2^2 + fl 3*l “ ® ~ g “ "g"’ 

46 

h = ufy + a 2 h + ^3^ + ^ = “7 

= i. ( , = , 3601 

^ “ 0|®5 + + +if 5^ “ Tt^T' 


Therefore, 

i.i. 

k i 2' 

fel 

S* 2‘ 

il = ?l =0.5106382 
t 4 27 

^. = 11 = 0.5103695 

fci 92 

i-1^ = 0,5109691 
^ 3601 

The root, correct to four decimal places, is D.5llfl, 
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Example 2J7 Using Ramanujan's method find a real root of the equations 


1-JT + 


x 2 x* _ * 4 


Let 


I- 


(2!) 2 (3!) 1 (4!) 3 

^ x 2 ^ X* jc 4 t 

m 2+ m 2 C4i) 2 


-= 0 , 


= 0 . 


To apply Ramanujan's method, we write 


1- 


2 1 4 "ll" 1 

—-^r+'- =^+^j + £>jjc 2 

[ (2D (3D 2 (4!) 2 JJ 


Here 


O! =1> 

1 

<* -f 

(41) 2 


4*2 =- 


J 


(2!) 3 

1 


*** = <5t) 2 






Hence, we obtain 


h i“«!-•- 

4*5 ~ =1 - 


1 _3. 

( 2!) 2 4 ' 


(J) 


(ii> 


= 3_1 1 _3 1 1 

4 (2D 2 (3D 2 4 4 36 

-1? 

= 36* 

= djfy + 

19 I 3 l t l 
36 ” 4 ^ 4 + 36 ^ ” 576 
_ 211 
576' 
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It follows 


i-* 

£ = i = 1.333...; 

h 3 

4-1h*-3I = U42I0_ 

b 4 4 19 I? 


b 4 19 ^ 576 
"36*211 


l,4408.. +# 


where the last result is correct to three significant figures. 

This example demonstrates that Ramanujan's method is preferable when 
the given function consists of an infinite series. 


2.7 THE SECANT METHOD 

We have seen that the Newton-Raphson method requites the evaluation of 
derivatives of the function and this is not always possible, particularly in the 
case of functions arising in practical problems. In the secant method, the 
derivative at x, Is approximated by the formula 

which can be written as 


f- f* ~fi- 1 1 (2.36) 

where f { = f (xj). Hence, the Newton-Rapkson formula becomes 

_ //<** J,-i/-«;/;-] (2 37) 

' f, -/m 

It should be noted that this formula requires two initial approximations to 
the mot. 

Example 2J$ Find a real root of the equation jc j — 2jc — 5 = 0 using secant 
method. 

Let the two initial approximations be given by 
x_i = 2 and * 0 = 3. 

We have 

/(*-!> = = MKl /W = A = 27-11-16. 
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Putting f = 0 in (2.37), we obtain 

_ 206) _ -3(-l) _ 35 = 2.058823529. 
1 17 17 

Also, 


/(r,) - /j = -0 390799923. 
Putting i = l in (2,37), we obtain 


_ *tf\ ~*i/& 3(-0.390799923)- 2.058823529(16) „ 

2 ~ -16390799923 


Again 


f(x 2 ) = fr =-0.147204057. 

Setting i - 2 in (2.37), and simplifying, we get x$ = 2.094824145, which is 
correct to three significant figures. 


2.8 MULLERS METHOD 

In this method, f(x) is approximated by a second-degree curve in the 
vicinity of a root. The roots of the quadratic are then assumed to be the 
approximations to the roots of the equation /(i) = 0. The method is iterative, 
converges almost quadratically, and can be used to obtain complex roots. 

Let *j_ 2 , */_], jc ( be three distinct approximations to a root of /(*) = 0. 
Let y t _ 2 > L'm+ Yt be the corresponding values of y = /(r). Now, any second- 
degree curve passing through the point (x s , y { ) may be written as 

p(*) = j|(*-^) 2 + JJ(x-jq)+y J , (2.38) 

Since the curve also passes through (x^.y^) and we 

obtain 

Yt-i = A{ x { _ 2 -x t } 2 + fi(r ( _ z -x t }+y (i 
arid. 

>Vl = A (*1-1 " x if + 5 (*M ~ x i ) + Yr 
Solving (2.39) and (2,40), we get 

A - , ~J , l __ + _ Zk- l Z l l __ (2.41) 

(Vl - *i-2 ) (*.-l - *i) (*i-2 - *i ) (Xf-2 - *f-l) 

and 

B = MZIl - A C* w - *,) (2.42) 

*i- i-*i 

With these values of A and B, the quadratic Eq. (2.38) gives the next approxi¬ 
mation x i+i : 


(2.39) 

(2.40) 
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*< + 2A 

A direct solution from (2,43) leads to inaccurate results and therefore we 
take the equivalent form : 


*r+l =*i 


2y t 

B* -4Ayj 


(2.44) 


In (2.44), the sign in the denominator should be chosen so that the denominator 
will be largest in magnitude. With this choice* Eq, (2,44) then gives the next 
approximation to the root. The following example illustrates the application 
of this method. 


Example 2J9 Find the root of the equation p(jf)tsjr-2r-5"0, which lies 
between 2 and 3. 

Let X {_2 =1c*j-l- 2 and x^=3. Then JV2 -”6, Em --1 and y t -16. Hence 

-22 


.1 -»7 , 

K-l) (-2)(-l) 


= 17-11=6, 


and 


a = “-6(-i)=2i. 

The quadratic equation is given by 

6 (*- 3 ) : + 23 (*- 3)+16 = 0 , 
which gives the next approximation: 


2(16) 

23 + 7(23)’-4(6)<16)’ 


where the positive sign is chosen since B is positive. 
Hence 


x - & 2.086799548 

23 + /I45 

The error in the above result is given by 

2m799548 - 3 ,100%, 

2.08679954 & 

which simplifies to 43.7 6%. Since this is quite large, we proceed to the next 
iteration with 

x # _2 = L x M = 2, x t = 2.086799548. 
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Tile corresponding values of y aTe 

Vj _2 = -6, v d _| = “1, =-0.086145588. 

Using these values in Eqs. (2.41) and (2.42). we obtain 
A = 5.086799558 and £=10.96986336, 

The next approximation x r+ | is obtained as 

= 2.086799548 + 2 ^ a0S6l45j3 ^ a 2.09462409. 

1+1 22.01031047 

The error in this result is 0.373553519%, 

2.9 GRAEFFE’S ROOT-SQUARING METHOD 

This is another method usually recommended for the numerical solution of 
polynomial equations. It, however, suffers from the disadvantage of having 
a numerically complicated procedure. 

Let P a {x) be a polynomial of degree h. Graeffe’s method consists in 
transforming /^(jc) into another polynomial, say Q n {z), of the same degree 
but whose roots are the squares of tine roots of the original polynomial The 
process is repeated so that the roots of the new polynomial are distributed 
more spaciously. This is possible provided that the roots of the original 
polynomial are all real and distinct. The roots are finally computed directly 
from the coefficients. We consider, for example, 

^)={* + l)(*-2)(* + 3) 

Then 

Pj HO = (-* + !)(-*- 2)H + 3) 

Hence, 

ACO P 3 <-*) = (-1) 3 (x 1 - 1) (x 2 - 4) (x 1 -9). 

Thus, we obtain 

where 

z = jc 1 . 

It is seen that the roots of (2,49) are the squares of the roots of the 
original polynomial Pj(x). 

Again, 

Qj (-z) = (-z -1) (-z - 4) (-z - 9) (2.51) 

= (-1) 1 (z + l)(z + 4) (z+9), (2.52) 
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Hence 

a ( 2 ) at-*)- H) 5 (* 2 -1) (x 2 -16) (z* - S I) (2.53) 

The next new polynomial is therefore given by 

5 3 (u) - (if -1) (u -16) (u -81), (2,54a) 

where 

u = z 1 . (2.54b) 

Suppose that the above procedure is repeated m times (he, the squaring 
is done m times successively); then the roots are estimated from the formula; 


a i 



0-1* l 


(2,55) 


where the <^ T s are the coefficients of the new polynomial (obtained after 
squaring m times) and n is the degree of the original polynomial. 

It is clear from the above discussion that this method gives approximations 
to the magnitudes of the roots. To determine the signs of the roots, we 
substitute each root in the original polynomial and find the result. If the 
result is very nearly zero, then the root is positive, otherwise it is negative. 
The method of application is illustrated below, 

Example 2*20 Find the real roots of the equation j? -6x* + lbc-6= 0* 
Let 

JC 3 -fix 2 +1 Ijc—6. 0) 

Then 


Hence 


l,ei 


W-x) - HO 5 -GH0* +1 \{-x)-6 
^(-\?(x*+6x 2 +\\x+6). 


P } {x) /£(-x} = (-]) 3 (x 6 - \Ax a + A9x 2 - 36), 


Q j (i) -z*~\ 4 m 2 + A9z - 36. 

where i = * 2 , Therefore, roots of / > J (x) = 0 are given by 


49 V 14 


— = 1,871 /14 = 3.741, 

14 v 


Again 


gj(-z) = (-l} 3 (z 3 +14z 2 + 49 z + 36). 


m 


(ill) 


(iv) 


Cv) 


(vi) 
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Hence, 

(J(; z) Q$(-z) - (-I ) 3 (i* - 98/ +1393/ -1296). (vii) 

It follows that 

£ 3 (m) = / -98m 2 +1 393m- 1296* (viii) 

where u = z 2 = r 4 From the roots of the new polynomial S^(u) * 0, we 
obtain the approximation to the roots of /^(jt) = 0 as 

Gif— (fF- (98>*«=3.147. (ix> 

Hie convergence to the exact roots, 1* 2 and 3 is quite clear. 

2.10 LIW-BAiftSTOtrS METHOD 

A method which is often useful in finding quadratic factors of polynomials 
is Xrn-Jafmow’s method and this is briefly described below; 

Let the polynomial be given by 

f(x) - , 45 / + ^ = 0. (2.56) 

Let x l + Rx+ 5 be a quadratic factor off(x) and also let an approximate 
factor be je 2 + rs +j* Usually, first approximations of r and s can be obtained 
from the last-three terms of the given polynomial Thus, 

r = arj( i j = ^ (2.57) 

Let 

f(x) = (jf 2 + rx + s) {^r + B l ) + Cx + D 

= BjX*+(B 1 r + B i )x 1 +(C + Bf + $B 2 )x+{B i s*D\ (2.5£) 

where the constants B lt B 2t C and jD have to be determined. Equating the 
coefficients of the like powers of x in Eqs, (2.56) and (2.58), we obtain 

b 2 = a } 

B\ — — rBj 

C — . L< /j ~ pB^ “ sB^ 

D = A i) -sB l 

From (2.59), it is clear that the coefficients B of the factored polynomial 
and also the coefficients C and Z> are functions of r and s. Since jr + Rx + $ 
is a factor of the given polynomial it follows that 
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C(J? T 5) = 0 and D(R, S) = 0 

Letting 

/? = r + Ar and 5 = j + Aj 
Eqs. (2.60) can be expanded by Taylor's series 

J-V -1 i/i 

C(J?,S)^C(i\j)+Ar— + Af— =0 
tV m 


( 2 . 60 ) 

( 2 . 61 ) 

(2.62) 


S) = f>(r t *)+ At ^ + Aj ^ a 0 t 
cfr 1 cw 

where the derivatives are to be computed at r and s. 

Equations (2.62) can then be solved for A r and A?. Use of these values 
in (2.61) will give the next approximation to R and S f respectively. The 
process can be repeated until successive values of R and S show no significant 
change. The following example illustrates the application of this method. 

iExample 2.21 Find the quadratic factor of the polynomial given by /( x) - 
X 3 - 2x 2 +JC-2. 

Wt have A j = l, A 2 = -2 t A x = 1 and --2* It is easily seen that r--t/2 
and i = l. Equations (2.59) give 

Sj=i 

B, -2-r, 

C-l-r (™2-r) - j = 1 + 2r + r 2 -f, 

D^-2 -s(-2-r ) - -2 + 2s + ». 


Also, 


UK'. »)]<-«,!>—2+2-1 — i; 

= 2 + 2f =1; 


H-ta, 1} 


f—1 

f ^ m-loj) 


. i. 

X = J ^ 1; 

/ (“l/l. l) 


Ss j f _ 


= 2 + r = —. 


(-in, L) 


Presented By: http://www.ebooksuit.com 


Copyrighted m; 



50 Ckaj ) ter 2 : Solution of Algebraic and Transcendental Equations 
Equations (2.62) give: 

3 3 I 

Ar - Aj - - and A/ 1 + — As = 

4 2 2 


Hence 


Thus 


and 


13 I 

Ar=— and As--. 

20 10 


/e = -i + H = A = 0,15 
2 20 20 


1 0 

S-l-^-^-03. 

10 10 

It follows that the quadratic factor is x + 0.15jc + 0.9. Thus, for the second 
approximation, the approximate quadratic factor is jr 2 + 0.1 5 jc + 0.9 so that 
r =0.15 and s = 0.9. Now, 

C = 1 + 2.15(0.15) - 0.9 = 0.4225, 

Z> = -2 + 2.15 (0.9) = 0.065, 

dCfdr = 2 + 2(0.15) = 2.30, 

dCfds = - 1 , 

dDtdr = 0.9, 


azy3j = 2 + r = 2.15. 

Hence, Eq. (2.62) give 

2J At -As = -QA225 and 0.9 At- + 2A5As = -0.065 
Solving the above equations, we obtain 

At = -0.1665312, Ar = 0.0394783, 

The second approximations are therefore given by 

R = 0.15-0.1665312 = -0.0165312 
5 = 0.9 + O.0394783 = 0.93947B3 

Thus the second approximation to the quadratic factor of f(x) is 
jr 3 —0.0165312r + 0.9394783, and it can be seen that R and S are approaching 
their actual values 0 and I, respectively. 
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2.11 THE QUOTIENT-DIFFERENCE METHOD 


This is a general method to obtain the approximate roots of polynomial 
equations and ii originally due to Rutishauser [1954]. We adopt here the 
notation and methodology described in Henrici (. 1958], The procedure is 
quite general and b illustrated here with a cubic polynomial. Let the given 
cubic equation be 


/ (x) = .x 3 + a, x 2 + QjX + dj = 0 (2.63) 


and let f x 2 and jcj be its roots such that 0<|X|j<|j^|<|x)|. Then/(jr) can 
be expressed in the following way; 


I 

m 








(2.64) 


where 


°i 



(2 65 ) 


The method derives its name to the qvaiients ^ and the differences ^ 
defined by the relations 


gW—SL 

«/-1 

and 

*r-«r , -*i o 

We have already seen that 

t-*® Of, 

tends to the smallest root of the equation f (x)-Q (see, Section 2,6). The 
quotient-difference method is therefore an extension of Ramanujan's method 
and determines all the real roots of a polynomial equation. Using the definitions 
(2.66) and (2.67), starting values of and &\ i} can be found and these 
are used to generate a table of quotients and differences from the general 
formulae; 


( 2 . 66 ) 

( 2 . 67 ) 

( 2 . 68 ) 


aW -(0 

*t r *i a r Vr 


(2 69) 
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and 

A?> + q <■> = A + q <2.70) 

A[, r) =A‘ ,) =0, for all i, n being the degree nf the polynomial. These formulae 
can easily be established using the definitions and their proofs are left as 
exercises to the reader {see, Herrici [1974]). A typical quotient-difference, 
table is given in Table 2.1. 


Table 2.1 A Typical GuotSinbdifference Table 


*0 

9t 

4) 

93 

*2 

9^ 



«F 


4'* 






-t* 

41* 

4-t 

** 

Af* 

AP 

flp 

A? 

4? 

&P 



A? 


A? 


$ 




If the first-two rows are known, the succeeding rows can be generated using 
the formulae (2.69) and (2.70) alternately. To determine the differences A 
formula (2*69) is used whereas formula (2.70) determines the quotients 
As the building-up of Table 2.5 proceeds, the quantities q[*\ qP 
and 9 tend to the reciprocals of the roots of the cubic equation (2.63). 
However, instead of (2*63), if we consider the transformed equation 

+ a 2 x 2 + = 0 ( 2 . 71 ) 

and proceed as above, we obtain, directly, the roots of Eq. (2.63). The 
following example illustrates the method of procedure : 

Example 2.22 Find the real roots of the equation x 3 - 6 x 2 + Ux-6=0- 
Let 

/(*)=**—6* 1 +Jl*-6 = 0. (i) 

To obtain the roots directly, we consider the transformed equation 

^6:r 5 +lJjE 2 -6jc + l=G (II) 
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Let 


“X a i x ' =od+«]*+«2* J +«3 j(3 + 


Hence, 


-6j 3 + 11* 2 ^6uc + l J 


(HSx 3 4* 1 ljf —6l + 1) + ffjJc 4 -§■■'•) 


m 


Comparing the coefficients of like powers of x on both sides of (iii), we 
obtain 

= 1, a T - 6a Q = 0, a 7 -6a^ +1 la^ = 0, - Sa 2 + 1 ltt[ - for 0 - 0 7 etc 

The above equations give 

a, =6, a t = 25* df 3 -t 90*.,. 


Hettce 


Again, 


and 


qP=a^ = 6 . 00000 , 
f P = a 2 )a x = 25/6 = 4,16667, 
g } 1} = cr 3 /ff 3 - 90/25- 3.60000 

A| n -g{ 2) - 9l (1> —1.83333, 


ij 2) = -fj 2> = -0,56667. 

Now, in the rhombus (see Table 2.1)* 






(2) 


tf 


,e> 


all the quantities except gj l * ate known. Taking r-! t and r = L formula 
(2.69) gives 

A (a) ff p> 

■- ■ .■■■— -1.28789. 




Next, we need to determine the value of A?'. For this, we consider the rhombus 


ff* 




Af 


»P 
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in which all the quantities, except A^*, are known. Using formula (2.70), 
we obtain 

= l ,28789 -1.83333, since qf' =0 

= -0.54544. 


Also, 

A<-'»=0. 

Thus, all the quantities in the first-two rows are known and the succeeding 
rows can be built-up, using the formulae (2,69) and (2,70), alternately. The 
numerical results are shown in the following table; 


Aq 

91 


% &2 

9a 

^3 


6*00000 


0 

0 


0 


-1,83333 

-0,54544 


0 


4.16667 


1-28789 

0.54544 


0 


-0,56667 

-0,23100 


0 


3.60000 


1,62356 

0.77644 


0 


-0 25556 

-0,11047 


0 


3,34444 


1,76865 

0.88691 


0 


-0,13516 

-0.05540 


0 


3.20929 


1,8464 

Q.. 94231 


0 


-0,07784 

-0.02624 


0 


3,13145 


i.eee 

0.9706 



[t is evident that q u q 2 and #3 are gradually converging to the roots 3, 2 
and 1 , respectively, 

2,12 SOLUTION TO SYSTEMS OP NONLINEAR EQUATIONS 

lit this section, we consider the solution to simultaneous nonlinear equations 
by two methods: (i) the method of iteration and (ii) Newton-Raphson method. 
In both the cases, the first approximations are usually obtained from a 
graph. For simplicity, we consider the case of two equations in two unknowns, 

2*12.1 The Method of Iteration 

Let the equations be given by 

/(x + y) = 0, >•) = 0, (2.72) 
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whose real roots are required within a specified accuracy. As in the method 
of iteration for a single equation (see Section 2.4), we assume that the 
equations in (2.72) may be written in the form 

x-F{x,y% y = G(x,yl (2.73) 

where the functions F and G satisfy the conditions: 


dF 

dx 



and 


AG 

Har 


+ 


dG 


(2.74) 


in the neighbourhood of the root. 

Let (q 3 ,y 0 ) be the initial approximation to a root of the system 
(2.72). We then construct the successive approximations according to the 
following formulae: 


*i = y 0 ) t 

x 2 = 

x l 


ft -G (x 0 t y 0 ) 
y 2 =G(x l ,y l ) 
yi = G(x 2 i yi) i- 


(2.75) 


For faster convergence, recently computed values of x f may be used in the 
evaluation of y t In (2.75). If the iteration process (2.75) converges, then we 
obtain 

and i J = G(^Jt) (2.76) 

in the limit Thus, f and *7 are the roots of the system (2.73) and hence, 
also, of the system (2.72), Conditions (2.74) are sufficient for the convergence 
of the iteration (2.75). We state the following theorem: 

Theorem 2,2 Let x = £ and y=rf be one pair of roots of the system 
(2.73) in the closed neighbourhood R, If the functions F and G and their 
first partial derivatives are continuous in R, 


dF 
— + 

dF 

< 1 and 

dG 

T 

dG 

Tv 

Dy 

■ 

i 

ox 


ay 


for all (x, y) in A, and the initial approximation (jcq, y<j) is chosen in R, then 
the sequence of approximations given by (2,75) converges to the roots 
jf" 4 and y = r} of the system (2*73). 

The proof of tills theorem is similar to that of Theorem 2J and is 
omitted here. The method can obviously be generalized to any number of 
equations. 
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Example 2.23 Find a real root of the equations: 

x = O-ir 2 + 0.8, y = Q.3xy* + 0.7 

We have 

F(x t y) = 0.2x 2 + 0,8, G(x, y) = 0.3xy 2 + 0.7 

Then 

~ = 0 . 4 *. s l-o 

dx dy 

” = 0.3y 2 , 52 = 0.6i y. 

& By 

It is easy to see that x = 1 and y - 1 are the roots of the system. Choosing 
x o = yo = 1^2, we find that 


dF 


dF 

dx 

+ 

(Xq, >u) 

dy 


- 0-3 c I 


Wn JKj) 


and 


&G 

&G 

““ 1 + 

dy 




= 0.225 


<1 


Thus, conditions (2.77) are satisfied. Hence* 

4 

and 


V\ =G(xa,ya) = -^- + 0.T = 0^4 
For the second approximation,, we obtain 

*1 = F{**,>|) = 0.2 ! ((0.85) J +0.8*0.9445 
^2 = G(i„ .>>,) = 0.3 x (0.85) *(0.74) J +0.7 = 0.81 

Convergence to the root {1, 1) is obvious. In computing the y values In the 
above, we could have used the recently computed values of x for a faster 
convergence. For example, 


Vi = G (ij f yjj) = 0.3 k ix(0J5) = 0,764, 
4 


which is a better approximation than the previously computed one. 
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2.12.2 Newton-Raphson Method 

Let(%, y 0 ) be an initial approximation to the root of the system (2.72). If 
(r 0 + + k ) is the root of the system, then we must have 

/(*0 +A»>t> +*) = 0i +ky$ +*) = 0 (2 ?S) 

Assuming that/and g are sufficiently differentiable, we expand (2.78) by 
Taylor’s series (see Theorem 1.6, Section 1.2) to obtain 


=0 

go+A ^ +t Jr + "* 0 ’ 

ar 0 


(2.79) 


where 

* fo - /{xq * etCj 

Neglecting the second-and higher-order terms, we obtain the following 
system of linear equations; 


_£ = 
dxo 


£ 

dx 


and 


If the Jacobian 


kSL 

dt 0 



*&-+**- 

dxft dy$ 


~ ~fo 

a -«0 


(2.80) 


£ 




gx 

dg 


dx 


£ 

dy 

dg 

dy 


(2.81) 


does not vanish, then the linear Eqs. (2.30) possess a unique solution given 
by 


h— 1 - 

-/ 

£ 

dy 

and t — ^ 

£ 

dx 



-g 

£ 

«■ »« K — 1 -— 


-g 


dy 


dx 


The new approximations are then given toy 

x^xq+h, >'i = Vo + * (2.83) 
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The process is to be repeated till we obtain the roots to the desired 
accuracy. If the iteration converges* it does so quadraticalfy. Theorem 2,3 
below (stated without proof) gives the conditions which are sufficient for 
convergence: 

Theorem 23 Let (jq, y Q ) be an approximation to a root (£, tj) of the system 
(2,72) in the closed neighbourhood R containing If (a)/* g and all 

their first and second derivatives are continuous and bounded in R, and 
(b) /(/, g) * Q in /?, then the sequence of approximations given by 

f s s f 

<t & aid yM-n—3 —.: 8g Sf <2.8“) 

By By * & | 

converges to the root (£■ rj ) of the system (2,72), 

Example 234 Find a real root of the equations x 2 - y a - 3 and x 2 + y 2 = 13. 

For starting the solution, we take y = x as our first approximation. This 
gives 

= 2.54951, 

and therefore 

/o=-3 and g 0 =0* 

where 

/ = x 2 -y 2 -3 and g-x 2 + y 2 -13. 

Further, 

3- = 2xq = 5,09902, = 2^ = 5,09902, 

3*0 dxq 

= _2y 0 = “5.09902, — = 2y 0 = 5.09902. 

Hence 

JL it 

&& 5,09902 - 5.09902 

= * 0 ; 

Bg dg 5.09902 5.09902 

and therefore the convergence criterion is satisfied. We then have 
h(5,09902) + k (-5.09902) =3 and /i(5.09902) + *(5.09902) = 0. 

These equations give 

h- 0,29417 and k --0,29417, 
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Hence the first approximation to the root is given by 
x, = xq + h = 2 ,$4951 + 0.29417 = 2.B4368 
y x = y<i + Jt = 2.54951 - 0,29417 = 2,25534. 
For the second approximation, we have 

f\ =/(Wi)*-0’D0OO42573 
£l =g(*i,yi)^ 173074458. 

Then 


- 2.T, = 5,68736, 


- “2yj = -4,5106S t 

ay, 


Sc, 


= 2t| = 5.6S736, 


— = 2^ = 4.51068. 

ay, 


Clearly, the condition of convergence is satisfied and we have the simultaneous 
equations 

ft (5.68736) + £{-4.S 1068) = 0.000042573 
and 

ft(5.68736) + £(4.51068) - -0,17307. 

Solving the above equations, we obtain 

ft = -0.0152 L and k = -0.01919. 
the second approximation is therefore given by 

* 2 = 2 . 84368 -- 0 , 01521 = 2 . 82847 , 

and 

y 2 * 2,25534 - 0.01919 = 2 23615, 

The above values may be compared with the true values, which are given by 
x = J8 = 2,82843 and y = js = 2.23607. 


EXERCISES 

Obtain a root, correct to three decimal places, for each of the following 
equations using the bisection method (Froblems I—10): 


2.1* 

** 

+ x 2 +x + 7= 0 

2.2. 

x 3 

o 

Oi 

I 

# 

t 

2.3. 

x } 

~*-4 = p 

2.4. 

X 3 

-18 = 0 

2,5. 


- x 2 -1 = 0 

2.6. 

x 3 

+ ^-1=0 

2,7, 

r 3 

-3x-5 = 0 

2.8, 

x 3 

o 

II 

2.9. 


- 5x + 3 = 0 

2.10. 

x 3 

+ X — 1 st 0. 
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Use the method of false position to obtain a root, correct to three decimal 
places, of each of the following equations {Problems 11-15): 


2.11. 

x 3 +x 2 + X+7 = 0 

2,12. 

x 2 ~ x - 4 = Q 

2.13. 


2.14. 

x 3 -x-l = 0 

2. IS. 

x 3 +jc-l = 0. 



Use the iteration method to find, correct to four significant figures, a real 
root of each of the following equations (Problems 16-25): 

2.16, 

cos x = 3x -1 

2.17. 

x = l/(x + i) : 

2.18, 

x = (5- j) 13 

2,19. 

sinx = lQ(x-1) 

2,29, 

*"*-101 

2J1. 

x sin x = 1,0 

2.22, 

$in 2 x = x 2 -l 

2.23. 

= cot x 

2.24. 

1 + x 2 = x 3 

2.2$. 

5x 3 - 20x + 3 = 0. 

2,26, 

Compute a root of the equation e x 
using the iterative method. 

= x l to an accuracy of 10" 5 , 

Use Newton-Raphson method to obtain a root* correct to three decimal 
places, of the following equations (Problems 27-36): 

2,27. 

^sin a _ 4 _ Q 

2.28, 

sin x = 1 - x 

2,29, 

x J -5x+3 = 0 

2.30. 

x 4 + x 2 -80 = 0 

2.3!, 

^+3^-3 = 0 

2.32, 

4(x - sin x) = 1 

2.33, 

x - cos x = 0 

234, 

sin x = (1/2) x 

2,35, 

x + bgx = 2 

236, 

x<T a * =(l/2) sin x 

2,37, 

Establish the formula 




u 

+ 

H 

f N 

L 



and hence compute the value of Jl 

correct to six decimal places. 


2.38, Find the least positive root of the equation tan x - x to an accuracy 
of 0,0001 by Newton-Raphson method, 

2.39, Obtain, to four decimal places, the root between ] and 2 of the equation 
x*-lx 1 +3r-5=0 by (a) Regula-Falsi, (b) Newton-Raphson 
method. 

2.40, Using Ramanujan's method, obtain the first-eight converged of 
the equation x + x 3 = 1. 
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2*4 L Using iteration method find the real root of the equation 


1- 



r 1 

(3!) 2 



= 0 . 


Solve the same equation using Ramanujan's method and compare 
the results. 


2*42, Using iteration method, find the teal root of the equation 


f j? 

x——+-^4._-...^0 

3 10 42 216 


2*43* Use the secant method to determine the root, lying between 5 and 
8, of the equation x 2 2 - 69. Compare your result with that obtained 
£n Example 2.5* 

2.44. Determine the real root of the equation xe* = 1 using the secant 
method. Compare your result with the true value of x =0.567143... 

2.45. Apply Graeffe’s root-squaring method to determine the approximate 
roots of the equations: 

(a) JE 3 ~2j*~jr+2=0 (b) X s -lx 2 + 1Qj-2^©. 

2.46. Use Muller’s method to find a root of the equations: 

(a) (b) 

2.47. Using Lin-Balrstows method, obtain the quadratic factors of the 

following equations: 

(a) x } -2 j? +x-2=Q (b) x* + 5x* +3x 2 -5x-9»0. 

2.48. Apply the quotient-difference method to obtain the approximate 
roots of the equations: 

(a) X i -X t -2x+l = 0 (b) Problem 45(b), 

2*49* Prove that 


(a) lim -2^- 

CCj _| 


x \ 


(b) lim 

i-)«* 


Oif/xj) 1 


1 El fi-il 

*l Pi t *l) 


(c) lim 


i/*, -«r 


*3 ^1 ( X 1 ) 


in the notation of Section 2.11. 

2.50. Develop a subprogram (in any computer language of your choice) 
for the Newton-Raphson method indicating the maximum number 
of iterations and also the tolerance for the percentage error in your 
solution. Test your program on Problem 36, 
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2*51. Develop a subprogram for computing roots by Muller's method. 
Use Problem 46(b) to test your program. 

2.52, Use a package of your choice to determine all the roots of the 
polynomial equation 

fU )»(Jt +1) (* - 2 J (x - 4) (j + 6) = 0. 

2*53* Develop a subprogram to implement Bairs tow's method and test it 
on Problem 47(b)* 

2.54. MATLAB has a subprogram nailed roots (c) for calculating the roots 
of a polynomial, whose coefficients are stored in the vector (c) and 
to return die roots to a vector (r). Use this program to obtain the 
roots of the equation 

x i -5x* + 9.25 x 2 ~ 7,75jt + 23 = 0, 

2.35* The following equation occurs in rocket dynamics: 

]=»/«. 

where is the mass of the rocket at time f -0, v is Us upward 
velocity at time f seconds* v r is the relative velocity at which the 
fuel is ejected* % is the fuel consumption rate and g is the acceleration 
due to gravity («9.S m/setr). Determine i (to within 1% of the true 
value) when v = 1500 m&ec t = 200,000 kg* v r = 2500 xn/sec and 
tff = 3000 kg/sec, using any subprogram of your choice. 

Solve the following systems of nonlinear equations by any suitable method 
(Problems 56-58): 

2*36* x 2 -y 2 =4,x l + y 2 =l6. 

2*57* + y-U* y 3 +*=7. 

2*38* x 2 =3jy-7* y=2(x+l). 


Copyrighted m; 


Presented By: http://www.ebooksuit.com 




CHAPTER 

■i 


Interpolation 


3.1 INTRODUCTION 

The statement 

y-fi 

means: corresponding to every value of x in the range there 

exists one or more values of y. Assuming that /(*) is single-valued and 
continuous and that it is known explicitly, then the values of/(x) corresponding 
to certain given values of jr, say % x u ...,x„ can easily be computed and 
tabulated. The central problem of numerical analysis is the converse one: 
Given the set of tabular values (x^ v Q ), (x 2 , y 2 \ (x„,y„) satisfying 

the relation y = f(x) where the explicit nature of f(x) is not known, it is 
required to find a simpler function, say ^(x) T such that/(x) and ^(x) agree 
at the set of tabulated paints. Such a process i$ called interpolation. If $(je) 
is a polynomial, then the process is called polynomial interpolation and 
${j) is called the interpolating polynomial , Similarly, different types of 
interpolation arise depending on whether $(x) is a finite trigonometric series, 
series of Bessel functions, etc. In this chapter, we shall be concerned with 
polynomial interpolation only. As a justification for the approximation of an 
unknown function by means of a polynomial, we state here, without proof, a 
famous theorem due to Weierstrass (1835); if/(x) is continuous in £* £ .fy, 
then given any £ >0, there exists a polynomial P(x) such that 

| /(x)“P(x)| for all x in rj. 
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This means that it is possible to find a polynomial P (jc) whose graph remains 
within the region bounded by y = fix) - e and y = f(x) + s for al! x between 
jqg and x m however small £ may be. 

When approximating a given function fix) by means of polynomial #(*)* 
one may be tempted to ask: (i) How should the closeness of the approximation 
be measured? and (ii) What is the criterion to decide the best polynomial 
approximation to the function? Answers to these questions, important though 
they are for the practical problem of interpolation, are outside the scope of 
this book and will not be attempted here. We will, however* derive in the 
next section a formula for finding the error associated with the approximation 
of a tabulated function by means of a polynomial. 

3,2 ERRORS IN POLYNOMIAL INTERPOLATION 

Let the function y{x), defined by the {n + 1) points i == 0 t L 2, *- t rU 

be continuous and differentiable {« +1) times, and let yix) be approximated 
by a polynomial of degree not exceeding it such that 

-y t . '=C3.i) 

If we now use ^ (jc) to obtain approximate values of y (*) at some points 
other than those defined by (3.1), what would be the accuracy of this 
approximation? Since the expression ><*)-$,(*) vanishes for x = %*!*... *x„ T 
we put 

yix)~h(x) = Lx tt+ iix), 0.2) 

where 

*«+!<*) ”(*“*!.) (3 3 ) 

and £ is to be determined such that Eq. (3.2) holds for any intermediate 
value of x r say Clearly, 

j , _ v<j')-a,00 (3.4) 

We construct a function F{x) such that 

F{x) = yix)-U*}~ ^« + i(4 O S) 

where L is given by Eq. (3,4) above, 

It is clear that 


F(x Q ) = F(x l ) = *^F(x n )^F{x') = Q, 

that is* F(x) vanishes (n + 2) times in the interval jcq, £ * £ jc„ ; consequently* by 
the repeated application of Rolled theorem (see Theorem 1.3, Section L2), F'(x) 
must vanish (n+ 1) times, F"{x) must vanish n times, etc., in the 
interval x$ £x<,x n . In particular* F* rt+IJ (x) must vanish once in the interval. 
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Let this point be given by jc = x$ <£<x n . On differentiating (3-5) (n +1) 
times with respect to * and putting * = £ we obtain 

0=y* +0 { ( f)-Z<rt + l)! 

so that 


i.^sa. (3.6) 

(»+di 

Comparison of (3,4) and (3,6) yields the results 

(« + l)! 

Dropping the prime on jr', we obtain 

XJ0-AV)=^^y‘“ l) (n. *><{<*., (37) 

which is the required expression for the error. Slice y(x) is* generally, 
unknown and hence we do not have any Information concerning 
y^fxX formula (3,7) is almost useless in practical computations. On the 
other hand, it is extremely useful in theoretical work in different branches 
of numerical analysis. In particular, we will use it to determine errors in 
Newton's interpolating formulae which will be discussed in Section 3.6. 

3,3 FINITE DIFFERENCES 

Assume that we have a table of values (*,, y ,), i = 0, 1, %..., n of any function 
y - f{x\ the values of x being equally spaced, he, x t -xq +ih , i=0,1,2 T 
Suppose that we are required to recover the values of f{x) for some 
intermediate values of js, or to obtain the derivative of /(.*) for some x in 
the range j 0 <x£x n . The methods for the solution to these problems are 
based on the concept of the "differences* of a function which we now proceed 
to define. 


3,3,1 Forward Differences 

If denote a set of values ofy, then y, ->'q *>' 2 *y»~ytt-\ 

are called the differences of> Denoting these differences by Ay 0 , Ay,,,.,, Ay aH 
respectively, we have 

Ay 0 = y l -y Qt Ay y = y 2 - . - y H 

where A is called the forward difference operator and Ay 0 , A> , 1 .are 

called fjrxt forward differences. The differences of the First Forward differences 
are called second forward differences and are denoted by A 2 y 0+ A 2 ^, 
Similarly, one can define third forward differences, fourth forward differences, 
etc. Thus* 
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A 2 y 0 = A V]_ -Ay 0 = v 2 “V| -Ol ~>fo) 

- v 2 - 2>^ + 

^Vo = A 2 J 4 -A*^ =J^ -iy 2 -2y x + y G ) 

= y? -3 j 2 +3vi 

A 4 >^ * A 3 > 1 , -A 3 y Q -y 4 -3y^ +3v 2 -(j*j -3j£ +3yj -y 0 ) 

= ^4 ” 4 >l + 6 v 2 - 4y, + y 0 . 

ft is me re fore clear that any higher-order difference can easily be expressed 
in terms of me ordinates, since the coefficients occurring on the right side 
are the binomial coefficients. 

Table 3.1 shows how the forward differences of all orders can be formed: 

Table 3.1 Forward Difference Table 

x y a A 2 A a A 4 A 5 A® 

mq y 0 

y\ 

*2 ¥2 

*3 ¥Z 

*4 YA 

*$ ¥S 

% ye 

3.3.2 Backward Differences 

The differences yj -y\,** t ,y n ~y^.\ are called first backward 

differences if they are denoted by .respectively, so that 

V>'| =>| -> r o Vy 2 = «y,, „„ y n -, where v is called the 

backward difference operator, in a similar way, one can define backward 
differences of higher orders. Thus we obtain 

V l yi =Vyi-V>i=^-y|-(^-y 0 ) = yi-2^ +j^, 

v? k3 - V 2 ^ - v2 >2 -T3 - h’2 + 3>j - y Q , etc. 

With the same values of x and y as in Table 3.1, a backward difference table 
can be formed: 


Ay 0 

AXi 

iy 2 

Ay 3 

m 

A Y5 


A 2 yo 

A 2 ¥l 
b 2 V2 
A 2 ys 

aV 4 


aVo 

aVi 

i 3 ya 

A 3 y 3 


A 4 y& 

Al 


a 4 Y!s 


A s y 0 

A S Xi 
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Table 3.2 1 

Backward Difference Table 



M 

y 

V 

V 2 

V 3 

V 4 

V 5 


*0 

Yo 








xi 

Vy T 






*2 

¥2 


vVj 





*3 

Yz 


v*y» 





*4 

¥4 


V*y, 


vV, 



*5 

Ys 


V a y 5 

?Vs 

''Vs 

^Vs 


*6 

¥& 


'Va 

vVe 

v 4 y« 

vVs 

vVe 

3.3.3 Central Differences 


The central difference operator S is defined by the relations 

yt -yo = n ~y\ - &y*n . x« -y*-\ 

Similarly, higher-order central differences can be defined. With the values of 
jr and y as in the preceding two tables, a central difference table can be 
formed: 




Table 3,3 

Central 

Difference 

Table 


X 

¥ 

s 



tf 4 a 5 



¥0 

Syvz 





*1 

Xi 

$YW2 

*V| 

^ 3 X3/£ 



*2 

X* 


J 2 /2 


J 4 y 2 




s Y5J2 


^ 3 xs^ 

(?S X5/2 


*3 

X3 


^ya 


J 4 xa 

As 



s ¥7I2 



$S Yit2 


*4 

*4 

s Y9t2 

^ Y 4 

2 

6*Y4 


*5 

ys 

^Xll (2 

■^ys 




*6 








It Is clear from the three tables that irt a definite numerical case, the 
same numbers occur in the same positions whether we use forward, backward 
or central differences. Thus we obtain 

“ %i s 3m * - V 3 y 5 - S i y m 
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3.3,4 Symbolic Relations and Separation of Symbols 

Difference formulae can easily be established by symbolic methods, using 
the shift operator £ and the averaging or the mean operator ft* in addition 
to the operators, A, V and £ already defined. 

The averaging operator p is defined by the equation: 

The shift operator £ is defined by the equation: 

£>V = >V + h 

which shows that the effect of E is to shift the functional value y r to the 
next higher value y r+J , A second equation with £ gives 

E*y r = E(Ey r ) = ^ = y„ 2 , 

and in general, 

e 'y,=y r +H- 

It is now easy to derive a relationship between A and E, for we have 

= y\ - Jto “ £Vo - >'o = (£ -l)>a 

and hence 

A = £ -1 or £ = l + A. 

We can now express any higher-order forward difference in terms of 
the given function values. For example, 

iVo -(E‘rfya = (^ -3£ 2 + 3£-1)y 0 =y 3 -3^ + 3y, -y 0 . 

front the definitions, the following relations can easily be established: 

V = t-£" 1 , 

£ st E U2 ~E~ ]J1 t 

l (3,8b) 

fj = (1/2) {E m + E~ m \ f? = l + (1/4) S 2 
A = VE = £E V2 . 

As an example, we prove the relation jj 2 m 1 + (1/4) S 2 . We have, by definition, 

1 , 

t*y r -~iy r +\n +y f -i/a) 

•The student should note that Eq. (3.8a) does not mean that the operators E 
and A have any existence as separate entities; it merely implies that the effect 
of the operator E on y* Is the same as that of the operator (1 + A) on jfo. 
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-!(£“+r la )y,. 

Hence 

and 

^ 1 (S 1 ' 2 + 

= !(£ + £-' +2) 

--E(£ M -£" I, ) J + 4] 

4 

=i(j 3 +4). 

4 

We therefore have 

Finally, we define the operator D such that 

dx 

To relate D to £„ we start with the Taylor’s series 

jl2 i 3 

y(x + h) = y(x) + h/(x) +— y"{x) + - /"(*) + ■*■ 


This can be written in the symbolic form 


Ey(*)= 


1 + hD 


2! + 3! 


+- boo. 


Since the series in the brackets is the expansion of e hD , we obtain the 
interesting result 


Eme™. 


tfSc) 


Using the relation (3,8a)* a number of useful identities can be derived. This 
relation is used to separate the effect of E into that of the powers of A and 
this method of separation is called the method of separation of symbols. The 
following examples demonstrate the use of this method. 


Example 3.1 Using the method of separation of symbols, show that 


^'Vii -««jh 


. , lvN _. 

+ _ —u x _ 2 +■" + (-!) u y _ n . 
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To prove this result,, we start with the right-hand side. Thus, 
-™«-i 

-u, -nE~ l u, + n<n ~ ]) E~ 2 u x + - + (-])" £'"u, 

2 


=^1 -nr' 


+ E~ 2 +■■■ + (-!)" E~” 


= {1 -ET'T*, 

'HI- 


£~1 

E 


= ¥-u 


= &"£-* M v 


which is the left-hand side. 
Example 3*2 Show that 


** +JC ^ + + h+h j = u b + u i x+ u z ^7 ■ 


Now, 


x 2 

uq+xAuq + —4 j h 0 + ' 


^f x ^l+lA+iA-+--J U() 


= E V\=<" l4a \ 


= e* E 


“o 


f r x 2 E 2 ' 

1 +xE +-+ ■ 

2 !: 


«D 


which is the required result. 
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3*4 DETECTION OF ERRORS BY USE OF DIFFERENCE TABLES 

Difference tables can be used to check errors in tabular values. Suppose 
that there is an error of +1 unit in a certain tabular value* As higher 
differences are formed, the error spreads out fan wise, and is at the same 
time, considerably magnified, as shown in Table 3.4. 


Table 3.4 Detection of Errors using Difference Table 


y 

4 

A 2 

A 3 

A 4 

A S 

0 

0 





0 

0 

0 

0 



0 

0 

0 

0 

0 

1 

0 

0 

0 

1 

1 

-5 

0 

1 

1 

-3 

*4 

10 

i 


-2 


3 


0 

~1 

% 

3 

“4 

^10 


0 


-1 


5 

0 

0 

0 

0 

-1 

-1 

0 

0 

0 

0 

0 


0 

0 

0 




0 







This table shows the following characteristics: 

(L) The effect of the error increases with the order of the differences, 
(ii) The errors in any one column are the binomial coefficients with 
alternating signs, 

(Hi) The algebraic sum of the errors in any difference column. Is zero, and 

(iv) The maximum error occurs opposite the function value containing 
the error. These facts can be used to detect errors by difference 
tables. We illustrate this by means of an example. 
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Example 3,3 Consider the following difference table: 

* ¥ & A 2 A 3 A 4 

1 3010 

2 3424 

3 3802 

4 4106 

5 4472 

6 4771 

7 5061 

8 6316 

The term —271 in the fourth difference column has fluctuations of 449 and 
452 on either side of it Comparison with Table 3.4 suggests that there is 
an error of -45 in the entry for * = 4, The correct value of y is therefore 
4105 + 45 - 4150, which shows that the last two digits have been transposed, 
a very common form of error The reader is advised to form a new difference 
table with this correction, and to check that the third differences are now 
practically constant. 

If an error is present in a given data, the differences of some order will 
become alternating in sign Hence, higher-order differences should be formed 
till the error is revealed as in the above example. If there are errors in 
several tabular values, then it is not easy to detect the errors by differencing. 

3.5 DIFFERENCES OF A POLYNOMIAL 

Let y(jcj be a polynomial of the nth degree so that 

y(jc) = + Ojx" -1 + + ■»+ a„. 

Then we obtain 

y{x + h)-y(x) = a 0 [(x + hf+ + - x*~'] + 

= % {nh) + of** -2 +**■ + aj,, 

where aj, a\ . a* n are the new coefficients. 

The above equation can be written as 

APC*) = + e[x n ~ 2 + + <, 

which shows that the first difference of a polynomial of the mb degree is 
a polynomial of degree (n - 1), Similarly, the second difference will be a 
polynomial of degree (n - 2\ and the coefficient of jc*“ 2 will be , 

Copyrighted n 


414 

-36 



378 

-75 

-39 

+178 

303 

+ 64 

+139 

-271 

367 

-m 

-132 

+101 

m 


+ 49 

-46 

m 

-16 

+3 


264 
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Thus the nth difference is which is a constant. Hence, the (n + l)th, 

and higher differences of a polynomial of nth degree will be zero. Conversely, 
if the nth differences of a tabulated function are constant and the (n + IJth, 
(ji + 2)th,,.., differences all vanish, then the tabulated function represents a 
polynomial of degree n. It should be noted that these results hold good only 
if the values of x are equally spaced. The converse Is important in numerical 
analysis since it enables us to approximate a function by a polynomial if tts 
differences of some order become nearly constant. 


3,6 NEWTON'S FORMULAE FOR INTERPOLATION 


Given the set of (n+ 1) values, viz,, U 0 , y 0 ), (x,, y,}, <x 2 , y 2 ).(x^y,,), 

of x and y, it is required to find y^*), a polynomial of the nth degree such 
that y and y„(jr) agree at the tabulated points. Let the values of x be equidistant, 
Le, let 


x f — + ih, t — 0, h 2,ft. 

Since y„(x) is a polynomial of the nth degree, it may be written as 


= +a l (x~x (i )+a 2 (x-x n )(x-x } ) 

+ d 3 {X-%}{4f-X|)(jf“4:2)+ - 


(3,9) 


Imposing now the condition that y and y^x) should agree at the set of 
tabulated points, we obtain 


d t> =>&; t7 i = 


x^-Xq h 


a, a, 



Setting x = x$ + ph and substituting for ... t a n , Eq, (3,9) gives 

y«(*) = >b + p^o + ^: l) & z y<> + p l p ~ ] ^ p ~ 2} +— 


2 ! 


3! 


+ p(p-Mp-Z)^(p-n+l) A » ( 3 , 10 ) 

n\ 

which is Newton's forward difference interpolation formula and is useful for 
interpolation near the beginning of a set of tabular values. 

To find the error committed in replacing the functiony(i) by means of 
the polynomial y^x), we use formula (3,7) to obtain 


y(*)-/«(*) = 


(* + !)! 


**<!<**♦ (3*11) 


As remarked earlier we do not have any information concerning y^ +l V*), and 
therefore formula (3,11) is useless in practice. Nevertheless, if y* rt+ll (jt) 
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does not vary too rapidly in the interval, a useful estimate of the derivative 
can be obtained in the following way. Expanding y(x + h) by Taylor's series 
(see Theorem 1.4), we obtain 

yd + h) =/to+ hy\x] +^>"00+... 

Neglecting the terms containing A 2 and higher powers of h t this gives 

h h 

Writing y(x) as Z>y{jc) where D * dfdx^ the differentiation operator, the above 
equation gives the operator relation 

Dm-& and so fl " +1 =^-4" +l . 
h k"* x 

We thus obtain 

0 12 ) 

n 

Equation (3.11) can therefore be written as 

(3 13) 

(n+L)! 

in which form it is suitable for computation. 

Instead of assuming y^x) as in (3.9) if we choose it in the form 

y fl O) = + ai(#~ J„)+ a 2 (x - x n )U -x„_i ) 

+ a 3 (r - *„} (x -1^) (x- 1„_ 2 )+*■■ 

+ a n (x-x n ){x-x n _ l )...{x-x i ). 


and then impose the condition that y and y„(jc) should agree at the tabulated 
points Jf„ Xi,Xi,Xft, we obtain (after some simplification) 


j ft ^ j 


where p = (x-x n )th. 

This is Newton's backward difference interpolation formula and it uses 
tabular values to the left ofy*. This formula is therefore useful for interpolation 
near ike end of the tabular values. 

It can be shown that the error in this formula may be written as 


y^)-y n i x ) 


p{p + ])(p + 2)..,(p + n) 
(n + 1)! 




where xq < £ < x n and x - x n + ph. 


(3.15) 


/riqht 
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The following examples illustrate the use of these formulae. 


Example 3,4 Find the cubic polynomial which takes the following values; 
XI) = 24, j?(3) = 120, X 5 ) = 33 *- and yO) = 720. Hence, or otherwise, obtain 
the value of yi$) r 

We form the difference table: 

x y & A 2 A 3 


I 

24 



96 


3 

120 

120 


216 

43 

S 

336 

168 


384 


7 

720 



Here h = 2. With =1, we have jc = 1 + 2 p or p(r* 1)72. Substituting this 
value of p in Eq, (3JO), we obtain 


jK*> = 24+~ I (W)+ 



= x*+6x 1 + lhH-6. 


To determine X 8 )* we observe that p = li2, Hence* formula (3JO) gives: 

>(8) - 24 + 2(96) + ™/2-1) Qao) + mS=3BB=2 m = 990. 

2 2 6 


Direct substitution in X*) yields the same value. 

Note; This process of finding the value of y for some value of x outside the 
given range is called extrapolation and this example demonstrates the fact 
that if a tabulated function is a polynomial, then both interpolation and 
extrapolation would give exact values. 


Example 3,5 Using Newton's forward difference formula, find the sum 


We have 
Hence 


S fl = l 3 +2 3 +3 3 + +n 3 . 


s n+ \- ]i + 2 J +3 3 + - +A 3 +(a+ I) 3 
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M„=(»r + l) J . 

It follows that 

A l S n = AS n+l -&S K = (ji + 2j J - (n + l) 3 = 3« 2 + 9n + 7, 

= 3<n +1) 2 + 9n + 7 - (3n 2 4- 9n + 7) = 6m + 12 

A 4 £„=6(fl+*) + 12-C&J + 12)=6. 

Since A 5 S rf = = ■ - = 0, S H is a fcmth-degree polynomial in n. 

Further* 


Si -h ASi-% & 2 Si = 19, 
Formula (3JO) gives 

^ = i +(n M )(S>+ 0L^^ (19 ) + 


(»-l)(n-2)(H-3)(a-4) 

24 


! ,4 I 


- — n 
4 


1 2 


w+±* 

2 4 


A? Si = 18, A 4 S x 


= 6 , 


(i) 


Erainp/e 3.<S Values of r (in degrees) and sin x are given in the following 
table: 


x (in degrees) sin x 


15 

0.2588190 

20 

0.3420201 

25 

0.4226183 

30 

0.5 

35 

0.5735764 

40 

0.6427876 


Determine the value of sin 38* 
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The difference table is 
x sin x a 


15 

0-2588190 

00832011 




20 

0.3420201 

0.0805962 

-0.0026029 

-0.0006136 


25 

0,4226153 


“0,0032165 


0.0000046 



0,0773617 


-0,0006888 

0.0000041 

30 

0.5 

0,0735764 

-0.0038053 

-0.0006599 

O.OOOQ269 

35 

0,5735764 

00692112 

-0,0043652 



40 

0,6427876 






To find sin 33*\ we use Newton's backward difference fonnula with = 40 
and jc = 38. This gives 

x-x n 33-40 2 

p- - - - -= — = -0.4. 

h 5 5 

Hence, using formula (3.14), we obtain 

y (38)= 0,6427876- 0.4 (0.0692112) + —- {^0.004365 2) 

5W) 


+ C ^4)(-0.4,l)(^44 2)(-0.4 + 3) (0 p()00289) 

+ + 2)(^0-4 + 3)(-fl,4+ 4) 

= 0.6427S76 - 0.02768448 + 0,00052382 + 0,00003583 
- 0,00000120 

- 0.6156614. 

Example 3*7 Find the missing term in the following table: 

x y 


0 

1 

2 

3 

4 


I 

3 

9 

81 


Explain why the result differs from V -27? 
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Since four points are given, the given data can be approximated by a 
third degree polynomial in x. Hence A 4 y 0 = O. Substituting a = £~1 and 
simplifying, we get 

£ 4 > j g - 4EVo + 6E 2 y 0 - 4Ey 0 + y 0 = 0. 

Since ^'yo = y r , the above equation becomes 

y4»4y 3 +6y 2 ’4y, + y a = 0. 

Substituting for and y 4 in the above, we obtain 

^3 =31- 

The tabulated function is 3' and the exact value of y(3) is 27. The error is 
due to the fact that the exponential function 3* is approximated by means 
of a polynomial in x of degree 3, 

Example 1 .8 The table below gives the values of tan x for 0.10 £ x £ 0.30 : 


JC 

y = tanjf 

0.10 

0,1003 

0.15 

0.1511 

0.20 

0,2027 

02$ 

0.2553 

0,30 

0.3093 


Find : (a) tan 0.12 (b) tan 0.26, (c) tan 0.40 and (d) tan 0.50, 
The table of difference is 


x y a a 2 A 3 A 4 


0.10 

0.1003 

0.0500 



0.15 

0.1511 

0.0516 

0.0000 

0.0002 

0.20 

0.2027 


0,0010 

0.0002 



0,0526 


0.0004 

025 

0,2553 

0,0540 

0,0014 


0.30 

0,3093 




(a) To find tan (0.12), we have 0,12 

= 0,10 +^0.05), which gives p - 0-4, 


Hence formula (3.10) gives 

tan (0.12) = 0.1003 + 0.4(0.0508) + HiM^il(o.0008) 
4 0 . 4 ( 0 . 4 - 1 )( 0 , 4 - 2 ) (OW2) 

+ 0.4(0.4-l)(0.4—2)(0.4-3 ) 

24 

= 0.1205, 
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(b) To find tan (0,26), we have 0.26 = 0 JO+ p(0.05), which gives 
p= -0.8, Hence formula (3.14) gives 

tan (0.26) = 0.3093 -0.8(0.0540)+ (0,0014) 

00Q4) 

+ -0.81-0 .g + l)(-^ + 2)(-0.8 + 3) (OQ002) 


- 0.2662. 

Proceeding as in the case (t) above, we obtain 

(c) tan (0.40) = 0.4241, and 

(d) tan (0,50) = 0 5543+ 

The actual values, correct to four decimal places, of ran (0,12), tan (0.26), 
tan (0.40) and tan (0.50) are respectively 0.1206, 0.2660,0.4228 and 0.5463. 
Comparison of the computed and actual values shows that in the first-two 
cases (i e. of interpolation) the results obtained are fairly accurate whereas 
tn the last-two cases (i,e. of extrapolation) the errors are quite considerable. 
The example therefore demonstrates the important result that if a tabulated 
function is other than a polynomial, then extrapolation very far from the 
table limits would be dangerous—although interpolation can be carried out 
very accurately. 

3,7 CENTRAL DIFFERENCE INTERPOLATION FORMULAE 

In the preceding section, we derived and discussed Newton's forward and 
backward interpolation formulae, which are applicable for Interpolation near 
the beginning and end respectively* of tabulated values. We shall, in the 
present section, discuss the central difference formulae which are most 
suited for interpolation near the middle of a tabulated set. The central difference 
operator tf was already introduced in Section 3.3.3+ 

The most important central difference formulae are those due to Stirling, 
Bessel and Everett. These will be discussed in Sections 3.7.2, 3.7.3 and 
3.7.4, respectively. Gauss's formulae, introduced in Section 3,7,1 below, 
are of interest from a theoretical stand-point only, 

3.7.1 Gauss' Central Difference Formulae 
Gauss’ forward formula 

We consider the following difference table in which the central ordinate is 
taken for convenience as y 0 corresponding to x = ,v 
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The differences, used in this foitmUa lie on the line shown in Table 3.5. 
The formula is* therefore, of the form 

y p = y 0 +G,Ay fl + G 2 A 2 y_^ + GjA 3 y_, +G 4 A*y_ 2 + —, (2A6) 

where G lr G 2t .. r have to be determined The on the left side can be 
expressed in terms of y$ t and higher-order differences ofy 0 * as follows: 


Table 3,5 Gauss' Forward Formula 


X 

f 

a 

A* 

A 3 

A 4 

a* 


y- a 






*-2 

y ~2 

&Y-Z 

A 2 y^ 

aVs 




y-i 


hV2 


&v 3 




A/-i 


a 3 y-2 


a 5 y~3 

% 

y^ 


* /-1\ /i y-2\ _ /A°y_3\ 

■^V-1 &*Y-2 

*1 

y\ 

m 

£>0 

A*y<| 

a*Y_i 


x 2 

y% 

& V2 

a 3 * 




*3 

*3 







Clearly, 

y P = EP ya 


™{l + A) p y$ f using relation (3,&a) 

* P(P- 1)*2 PiP- 1)0-2) *3 

*^ + ^+ 3 , ' *?yi, + FKF + - 

Similarly, the right side of (3,16) can also be expressed in terms of Ay a 
and higher-order differences. We have 

aV[ =A 1 E” I >o 
=A 1 d+Ar 1 ^ 

= d 3 (l-A + A 3 -A 3 +. 


= A J OlQ -Aro +A 3 >. a -A 3 y 0 + - ) 

=^>0 ~& 3 y<i +-a *j(, + ■■■ 
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A Vi “ - A Vo + AV - AV +— 

aVj =A+£- 2 y» 

= A s (] + A)-\v 0 

= A J (y c - 2Ay„ +3A 2 y 0 -4A 5 y 0 + •••) 

= A 4 >' 0 -2A 5 y 0 + 3A 6 >'( -4A , yo + ■■ 

Hence (3-16) gives the identity 

.o + ** + 

^-1)0-2)05-3) i4 ,. 

+ _--- 

= >0 + ^1 A >0 + (A V - A 3 >'0 + A Vi - AV + —) 

+ Gj(A 3 y 0 - A'V + A V ~ A V +'' ) 

+ 0,(A V - 2A S y 0 + 3AV - 4 aV +' “)+“■ (3 l7) 

Equating the coefficients of Ay 0f aV»aV etc > on sides (3-l?X 
we obtain 


G\=p. 


G, = 




Pip - 0 
2! * 

0 + 1 ) pip - 1 ) 
3! 


a i s) 


G 0 + 1)pQ-1)0-2) 

4 41 

Glass' Backward Formula 

This formula uses the differences which lie on the line shown in Table 3.6. 
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Table 3.6 Gauss" Backward Formula 


X 

y 

A A 2 

A 3 A 4 

A 5 A® 

Jf-1 

y -1 




*0 



X aV< 




A/0 

i 3 y.i 

A 5 y~2 

*1 

yi 





Gauss 1 backward formula can Aierefcre be assumed to be of the form 

>p=*> + Gi4v-1 + Gji 2 >--1 + GjiVVi + GiA 4 >-2 +••■ O'.19) 

where G(, GJ,have to be determined, Following the same procedure as 
in Gauss" forward formula, we obtain 


G{ = P, 

^ p(p + l) 

21 '’ 

c , (p+l)p(p«l) 

11 


(3.20) 


c; {p + 2)(j> + l)p(p-1) 


3*9 From the Following table, And the value of e 1 17 using Gauss’ 
forward formula: 


X 


1,00 

2.7183 

1,05 

2,8577 

no 

3 0042 

us 

3JS82 

no 

33201 

ns 

3.4903 

L3G 

3.6693 


We have 


1.17 = I.15 + p(0.05) t 


■py righted 


Presented By: http://www.ebooksuit.com 



Section 3,7: Central Difference Interpolation Formulae 


83 


which gives 

0.02 I 
P ~ 0,05 "4 

The difference table is given below. 


X 

ft' 

A 

A 2 

A 3 

A 4 

1.00 

2.71 S3 

0.1394 




1.05 

2,8577 

GJ465 

0.0071 

0.0004 


1.10 

3 0042 

0.1540 

0.0575 

00004 

0 

1.15 

3.15B2^^ 

. 0 . 1619 ^ 

0.0079 

^^,00004^ 

^,0 

150 

3,3201 

0.1702 

00083 

0.0005 

0.0001 

1.25 

3,4903 

0.1790 

0,0088 



1.30 

3.6693 






Using formulae (3.16) and (3.IS), we obtain 

e l 17 = 3.1582 +1 (0.1619) + (0.0079) 

+ C2/5,I)q/5)g/5-l) (00004) 


- 3.1582 + 0,0648 - 0,0009 


= 3.222 L 


3,7,2 Stirling's Formula 

Taking the mean of Gauss' forward and backward formulae, we obtain 


y P *yb+p- 


A^-i+Ay 0 1 p 2 i p(p 2 -i) aV, +a y 3 


3! 


+ pV^i> aV 

4! ' 2 


Formula (3,21) is called Stirling*s formula. 


(3.21) 


3.7.3 Bessel's Formula 

This is a very useful formula for practical interpolation, and it uses the 
differences as shown in the following table, where the brackets mean that 
the average of the values has to be taken. 
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f yo) 

&Yq 

f± 2 y- il 



c 

AV 

UJ 

——s 

- 

A-1 

^ Vi, 


A-2, 


Hence, Bessel's formula can be assumed in the form 

»-»f ****** % 

^ g /V; +A V-i + „. 


= + f^*|Wc + % y "' 


aVi + aV.1 


(3,22) 


Using the method outlined in Section 3.7,1, i.e. Gauss' forward formula, we 

obtain 


B i + 2 = P ’ 


n P^- 1) 

02 -M * 




(3,23) 


tp + i)pjp-lHp- 1) 


Hence, Bessel's interpolation formula may be written as 


y.-ya+p^y** 


pjp-3.^y = j±ih& PiP-MP-m^, 


(j, + l)p(p-l)(p-2) aV, +aVi 


(3.24) 
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3,7*4 Everett's Formula 

This is art extensively used interpolation formula and uses only even order 
differences, as shown in the following table: 



70 


i*y-, 


**Y-2 

aV-3 

*1 

71 


z*yo 


A-1 

AV-2 


Hence the formula has the form 

y p = + E%£?y_\ + + •**+F&yi + F^£?y^ + /4AV-1 + ■ - (3.25) 

The coefficients F 0 , E' 2 , F 2 +E 4 ,F At ,.. can be determined by the same 

method as in the preceding cases, and we obtain 


o = l ~P = ^ 

II 

. ^Cf 3 -! 2 ) 

3 3! 

r MP 2 -! 2 ) 
h -3! 

. <K ? J -! 2 K* 2 -2 J ) 

„ p(p 1 -1 i ){p : -2 J ) 

4- 5 , 

4 ' 51 


(3.26) 


Hence Everett's formula is given by 


♦* + ^-y-*) A 4,_, + . 


{3.27) 


where q = \-p, 

3,7.5 Relation between Bessel's end Everett’s Formulae 

These formulae are very closely related, and it is possible to deduce one from 
the other by a suitable rearrangement To see this we start with Bessel’s formula 

| (p+l)p(p-t)(p-2) A V-^ : + A Vrl , 

41 2 
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* , (p+\) p{ P -\)(p-2) aV-i+aV-, t 

4! 2 

expressing the odd order differences in terms of low even order differences. 
This gives on simplification 

„ . T pCp-1) Cp-1)p(P“1/2)1.2 

y P -(i - p)y<> + [ ^ - 6 — L |a y.\ + - 

fp(p-i) pip- i)(P-i«)l*i 

+ py\+ 4 ~ * £i£ ‘ — -f - - a ft + " 


= m + ?(? 3 ,' ’ ^ 2 , v -i + + py\ + pip y 1 ) A I jh + - 


which is Everest formula truncated after second differences. Hence we 
have a result of practical importance that Everett's formula truncated after 
second differences is equivalent to Bessel's formula truncated after third 
differences. In a similar way, Bessel’s formula may be deduced from Everett’s. 


3,8 PRACTICAL INTERPOLATION 

In the preceding sections, we have derived some interpolation formulae of 
great practical importance. A natural question is: Which one of these formulae 
gives the most accurate result? 

(i) If interpolation is desired near the beginning or end of a table, there 
is no alternative to Newton's forward and backward difference formulae, 
simply because higher-order central differences do not exist at the beginning 
or end of a table of values. 

(ii) For interpolation near the middle of a table, Stirling’s formula gives 
the most accurate result for -1/4£ p£\fA % and Bessel's formula is most 
efficient near 1/2, say 1/4 £ p £3/4. But in the case where a series of 
calculations have to be made, it would be inconvenient to use both these 
formulae, and a choice must be made between them. The choice depends 
on the order of toe highest difference that could be neglected so that 
contributions from it and further differences would be less than half a unit 
in the last decimal place. If this highest difference is of odd order, Stirling s 
formula is recommended; if it is of even order, Bessel’s formula might be 
preferred. Estimation of die maximum value of a difference of any order in 
an interpolation formula is not difficult. Thus, in Stirling’s formula (3.21), 
the term containing the third differences, viz., 

p{p l -\) aVi+aV.^ 

6 2 
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may be neglected if its contribution to the interpolate is less than half a unit 
in the last place. This means that 

i pip 2 -1) A 3 y., + | 


1 

< 2 > 


6 2 
for all p in the range 0 £ p £ 1, 

But the maximum value of p(p 2 -l)/56 is 0,064 and so we have 


0.064 


&Vi 


1 

2 


which gives 


2 


< 8 . 


If we consider Bessel's formula (3.24), the contribution from the tern 
containing the third difference will be less than half a unit In the last place 
provided that 


p(p-Mp-1/2) j 

6 y -‘ 

But the maximum value of 

p{p-\){p-\n) 

6 

if O OPS, and so |A'r.J <60. In other words* if we neglect the third 
differences, Bessel's formula is about seven times more accurate than Stirling’s 
formula. If the third differences need to be retained (i.e. when they are 
more than 60 in magnitude}* then Everett's formula may be gainfully employed 
for the aforesaid reason* viz.* Everett’s formula with second differences is 
equivalent to Bessel's formula with third differences. The following examples 
illustrate the use of the central difference formulae. 



Example 3JO The fol lowing table gives the values of e* for certain equidistant 
values of x. Find the value of e* when x - 0.644. 


X 


0.61 

1.840431 

0.62 

1.858928 

0.63 

1.877610 

0.64 

1.896481 

0.65 

1.915541 

0.66 

1.934792 

0*67 

1.954237 
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The table of differences is 


X 

ii 

"t, 

A 

A 2 

A 3 

A 4 

Ml 

1840431 

0,018497 




0.62 

1 ,856926 

0.013682 

0,000185 

O.O0OOW 


0.63 

1,877610 

0.018871 

0.000189 

0 

-0.OOOO04 

0.64 

1.896481 

0019060 

0.000189 

0.000002 

0,000002 

0.65 

1,915641 

0019251 

O.0O0191 

0.000003 

0.000001 

0.6© 

1.334792 

0.019445 

0000194 



067 

1.954237 





Clearly, 


0,644 - 0.64 

p =-—-* = 0 , 4 . 

0.01 

The third difference contribution to both Stirling's and Bessel's formulae is 
negligible, and using Stirling's foitnuJa, we obtain 

y (0,644) -1.8064 81 + 0 4 M 1 SS71 + Ml (O.OOG 180) 

2 2 

- 1 ,89648 1 + 0,0075862+0.00001512 


= 1,904082, 

whilst Bessel's formula gives 

y (0.644) = 1.896481 + 0 , 4 ( 0 . 010060 + ^^^-^-2^5211^2522121 

= 1,89648 1 + 0,0076240 - 0,0000228 
= 1.904082, 

Using Everett’s formula, we find that 

H0.644) = 0.6(1,896481) + 0,6 ~ ft (0.000189) 

2 

+ 0.4(1,915541) + - 4 ^ 16 ^ ^ (0,000191) 

= 1,1378886 - 0.000012096 + 0.7662164 - 0,000010696 


= 1.904082. 

In all the above cases, the value obtained is correct to six decimal places. 
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It is known from algebra that the nth degree polynomial which passes 
through {«+ 1) points is unique. Hence the various interpolation formulae 
derived here are actually only different forms of the same polynomial. It 
therefore follows that all the interpolation formulae should give the same functional 
value. This is illustrated in the above example where we found that the interpolated 
value of 0.644 is 1.904082 regardless of which formula is used. 


Example 3JJ From the table of Example 3. JO, find the value of e* when 
X -- 0.638, using Stirling's and Bessel’s formulae. 


It was mentioned in Section 3.8 that Stirling's formula gives the most 
accurate result for -1/4 S pS 1/4, and Bessel’s formula Is most efficient for 
1/4 ZpZ 3/4. In order to use these formulae, we therefore, have to choose 
a# so that p satisfies the appropriate inequality. 

To use Stirling's formula, we choose jeq - 0,64 and x n * 0.638 so that 
p = -0,2. Hence, 


y(0.638) = 1.896481-0.2 


0.018871 + 0.019060 0.04 


+-(0.000189) 

2 


- i .896481 - 0.0037931 + 0,0000038 


= 1.892692, 

which is correct to the last decimal place. 

For BessePs formula* we choose xq =0.63* * n =0,638 so that p = 0.8. 
Hence, we obtain 

y (0.638) = 1.877610 + 0.8(0,018171) + °'^ S ~ ^ (0,000189) 

z 

- J .877610 + 0.0150968 - 0.0000151 
= 1.892692, as before. 

Example 3A2 The values of x and e~ x are given in the following table. 
Find the value of e~ s when x = 1.7475. 


x y* e* 4 4 2 a 3 a 4 


1.72 

0.1790661479 

-17817379 




1.73 

0.1772844100 

“17640094 

177285 

-1762 


1.74 

0.1755204006 

-17464571 

175523 

-1749 

13 

1.7S 

a 1737738435 

-17290797 

173774 

-1727 

22 

1.76 

0,1720448636 

—17118750 

172047 

-1712 

IS 

1.77 

0.1703329888 

“18948415 

170335 



1,78 

0*1006381473 
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It should be noted that in writing the differences in the above table* the 
zeros between the decimal point and the first significant digit to its right are 
omitted. Thus, in the column of second differences* the number 173774 
should be taken as Q.TO00173774 in the computations. 

To compute 1.7475), we choose je^ -L?4 and x p =1,7475 so that 
p — 3/4. We shall obtain the solution by using both Bessel's and Everett's 
formulae. 

(i) If we use Bessel’s formula, the third differences need to be taken 
into account since they exceed 60 units in magnitude. Hence Bessel's 
formula gives 

y (J ,7475) - 0.1755204006 - - (0.0017464571) 

4 

(3/4X3/4 -1) 0.Q000175523 + 0.0000173774 
+ 2 2 

=0.1755204006-0.00130984284 -0.00000163734 +• 0.00000000137 

-0J74208921 ft, correct to ten decimal places. 

(ii) On the other hand, if we use Everett’s formula up to second differences 
only, we obtain 

^(1*7475)--(0.1755204006)» < 1/4 X [/L6 ~ (Q. 0 CK) 0175523 ) 

4 6 

+-(0.1737739435) + (3MX9 j 16 -1) (0.0000173774) 

4 6 

=0.04388010015 - 0.00000068564+0.13033045764 - 0.00000095033 
=0.1742089218* as before. 

This example verifies the result of Section 3.7.5 that Everett's formula 
tumcated after second differences is equivalent to Bessel's formula truncated 
after third differences. When the fourth difference contribution becomes 
significant (i.e. when they exceed 20 units in magnitude), Everett’s formula 
will be easier to apply since it uses only the even order differences. 

3*9 INTERPOLATION WITH UNEVENLY SPACED POINTS 

In the preceding sections, we have derived interpolation formulae of utmost 
importance and discussed their practical use in some detail, But, as is well 
known, they possess the disadvantage of req uiring the values of the independent 
variable to be equally spaced. It is therefore desirable to have interpolation 
formulae with unequally spaced values of the argument. We discuss, in the 
present section and the next* four such formulae: (i) Lagrange's interpolation 
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formula which uses only the function values, (ii) Hertnke’s interpolation 
formula which is similar to Lagrange’s formula, (iii) Newton's general 
interpolation formula which uses what are called divided differences and 
(iv) Aitken’s method of Interpolation by iteration. 


3.9*1 Lagrange's Interpolation Formula 


Let rfx) he continuous and differentiable (n + 1} times in the interval (a, b). 
Given the (n + !) points (^y 0 %{x u y l \^. r (z 9t y n ) where the values of * 
need not necessarily be equally spaced, we wish to find a polynomial of 
degree n, say L n {x), such that 

* = 0, L. n (3.28) 

Before deriving the general formula, we first consider a simpler case, 
viz,, the equation of a straight line (a linear polynomial) passing through two 
points (^,> 0 ) and (i|,yj). Such a polynomial, say I l (x), is easily seen to be 


,,. x-x I 

ii(j) s + —— y\ 
x & -x l X^Xq 


= 2 

1=0 


(329) 


where 


/ and = (3.30) 

*0 -*i x \ - 

From (3.30), it is seen that 

^o( T i) = 0 > f|(x,) = l. 

These relations can be expressed in a more convenient form as 



l, if r = / 
0 , if i * j. 


(3J1) 


Hie I t (x) in (3.29) also have the property 

y / ( <*)-V*Wl(,)=^-5.+^L = l. (3,32) 

its *0^*1 

Equation (3,29) is the Lagrange polynomial of degree one passing through 
two points (jcq, > r Q> and (X|, yj). In a similar way, the Lagrange polynomial 
of degree two passing through three points (jt^, yoM x i> yi) “d 15 

written as 
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(x~x l ){x~x 1 ) ^ | (x- 3 q)(jt-jc^} j X t ) ^ 

(xo-xOix^-Xj) 0 (x l -x i} )(x l -x 2 ) ] (x.-Xq) (x 2 -x i ) ■ : + 


(333) 


where the l£x) satisfy the conditions given in (3,31) and (332). 

To derive the general formula* let 

i B <Jr)-% + ^Jf + a2JC 2 + ■■ + 0 ^ (3,34) 

be the desire! polynomial of the flth degree such that conditions (3.28) 
(called the interpalaiory conditions) are satisfied. Substituting these conditions in 
(3.34), we obtain the system of equations 

^ = ^ + ^% + ^o +'"+Vo 1 


j^^O& + fl|JCi+^ 1 + ■+u fl x, 
ft = 00+^2 +a 2 xl +“' + o n x J 


(335) 


y,,* a o +a \x* +a 2 x ', + - + Wf 

The set of Eqs. (3.35) will have a solution if 


1 


1 


] 

*0 

Xq 

... x 

I 

ft 

«? 

■■■ X 

1 

ft, 


... x 


(3.36) 


The value of this determinant, called Vandermonde's determinant, is 

<*0 -ft) -(ft -x n Hn -x m ) 

Eliminating %,ci|. ^ from E*p.{3.34) and (3.35), we obtain 


4M i 


I ft 


- xt = °> 


(337) 


y n I 
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which shows that L^(x) is a linear combination of y| T j p 2 T y„. Hence 

we write 

!»<*)■=£ l,<t)y„ (3.38) 

/-0 

where I fa) are polynomials in x of degree n. Since ) = yj for j =0* h % 

- , Eq. (3,32) gives 

= 0 if t*j 

//*,) = 1 ftw all j' 

which are the same as (3.31). Hence lfa) may be written as 

; (v)K (x-^){x-x i )...(x-x I _ l )(x-x t+ 1 }...(x-x n ) q J9) 

' *~(*i - Xo)(Xi - x { ),„{xf - Jf M )(*,-**,)(JCf-x*) 1 

which obviously satisfies the conditions (3.31). 

If we now set 

= (3.40) 

then 

Rr+\ (*/ ) = ^ 


= (Xf - xq) ( Xi - Ij) - Jfj-j) tJCj -x,- + i) - to - ) (3.41) 

so that (3,39) becomes 




Hence (3.38) gives 



«»+)<*) 


(3-42) 


(3.43) 


which is called Lagrange's interpolation formula. The coefficients lfa), defined 
in (3.39), are called Lagrange interpolation coefficients. Interchanging x 
and y in (3.43) we obtain the formula 



gjt+i (>') x 


(3.44) 


which is useful for inverse interpolation. 

It is trivial to show that the Lagrange interpolating polynomial is unique. 
To prove this, we assume the contrary. Let Z*(x) be a polynomial, distinct 
from Lfx), of degree not exceeding n and such that 


4 W“>i* * — Oj V 2 , n. 
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Then the polynomial defined by where 

vanishes at the (#t + 1) points jq, j=G, 1, is. Hence we have 

0, 

which shows that £j(*) and £„(*} are identical 

A major advantage of this formula is that the coefficients in (3,44) are 
easily determined. Further, it is more general in that it is applicable to either 
equal ©r unequal intervals and the abscissae j^ + jc|, .^x n need not be in 
order, Using this formula it is, however, inconvenient to pass from one 
interpolation polynomial to another of degree one greater. 

The following examples illustrate the use of Lagrange's formula. 

Example $.13 Certain corresponding values of jc and log^jc are (300, 
2,4771), (304, 2.4829), (305, 2.4843} and (307, 2.4871). Find log| 0 301. 

From formula (3.43), we obtain 


log l0 30U 


(-3) (-4) (-6) 
(-4 M-3H-7) 


(2,4771) + 


(]}M)( ^(2 4B29) 

(4)(-l)(-3) 1 


, (1K-3X-Q 
(5) (0 (-2) 


(2.4843) + 


(1)(-3)M) 
(7) (3) (2) 


(2,4871) 


^ 1*2739 + 4.9658 - 4.4717 + 0.7106 
- 2.4786. 


Example 3.14 If - 4, jk 3 - 12, y A -\9 and y x =7, find jr. 
Using formula (3.44), we have 


(-5X-12) 
(-8) (-15) 


( 1 ) + 


Q) (- 12 ) 

(8) (-7) 


(3)+ 


PM-5) 
(15) (7) 


(4) 


1 

2 14 7 


~L86. 


Hie actual value is 2,0 since the above values were obtained from the 
polynomial = * 2 + 3 + 


Example 3JS Find the Lagrange interpolating polynomial of degree 2 
approximating the function y = In x defined by the following table of values. 
Hence determine the value of In 2.7. 

x y - In r 


2 

2.5 


3,0 
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We have 

. , , (i-2.5) (x-3.0) j .. 

L(x) = --—- - = 2.tr -1 Lr +15, 

01 (-0.5) (-m 

Similarly we find 

l v O) = ~{4x 2 - 20x + 24) and i 2 (x) = 2x 2 -9x + \ 0. 

Hence 


L 1 (x) = {2x 2 -I \x + 15) (0,69315) - (4 je 2 -20* +24) (G.91629) 

+ (2x 2 ~ 9*+ 10) (1.09861) 

* ^,0&164jc 2 + 0.83366JC - 0.60761, 

which is the required quadratic polynomial. 

Putting x = 2.7, in the above polynomial, we obtain 

In 2.7 * i 2 (2.7) = -4).08 164 (2.7) 1 + 0.81366 (2.7) - 0.60761 = 0,9941164. 

Actual value of In 2.7 ~ 0,9932518, so that 

| Error | = 0.0008646, 


Example 3-16 The function y = sin * is tabulated below 

x y- sin* 

0 0 

ff/4 0.70711 

g/2 1.0 

Using Lagrange's interpolation formula, find the value of sin (xJS), 
We have 


. Jf 
Silt — H 

6 


(jr/6-0)(*/6-*/3) 
(,f/4 - 0) {ti/4- jt/2) 


(0.70711)* 


C/r/2-0 ) (jt/2-^/4) 


=|(0.707U)-i 


4,6:5688 

9 

-0,51743, 


Example 3.17 Using Lagrange's interpolation formula, find the form of the 
function yfjt) from the following table 
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X 

y 

0 

-12 

l 

0 

3 

12 

4 

24 


Since y=0 when jc* 1, it follows that r-I is a factor. Let y(x)=(r-l)i?(jr). 
Then i?(x) myf{x - 1). We now tabulate the values of x and J?(x). 

X 

m 

0 

12 

3 

b 

4 

% 


Applying Lagrange's formula to tie above table, we find 




(-3)(-*> 


(3-03(3-4) (4-03(4-3)’ 


= (i - 3) (x - 4) - 2x {* - 4) + 2x (* - 3) 

-x 1 -Sjc + 12. 

Hence the required polynomial approximation to y(x) is given by 

y(jr) = (i-l)(;r 2 -5jr + 12). 


3.9J Error in Lagrange's Interpolation Formula 

Equation (3,7) can be used to estimate the error of the Lagrange interpolation 
formula for the class of functions which have continuous derivatives of 
order up to {* + )) on [a, £]. We therefore have 

= = a<z<b (3 45) 

V s + 

and the quantity E L , where 

(3.46) 

may he taken as an estimate of error. Further, if we assume that 

y^t^lSAV,, a&S&b (3.47) 

then 

£ ^&K IWl)l < 34S) 

Hie following examples illustrate the computation of the error. 
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Example 3.1$ Estimate the error in the value of y obtained in example 3 J5. 

Since y-lnx* we obtain y* y ,f »- Ifx*' sod y^sJ/jt 3 . It follows 
that y”\%)~21£?. Thus the continuity conditions onyx) and its derivatives 
are satisfied in [2,3]. Hence 

(.-aM-HE-g a 2<| « <3 

6 j“ 

But 


111 



When x - 2.7, we therefore obtain 




(2.7 -2)(2.7 -2.5)(2.7-3) 2 

6 I 


07*0.2*0.3 

3*S 


= 0.00175, 


which agrees with the actual error given in example 3.15. 

Example 3.19 Estimate the error in the solution computed in example 3.16. 
Since >■(*} = sin x, we have 

y(x)=cosx, y'(x)=-sinx, /"(xjsa-cosx* 

Hence |/ r, (f)|<l. 

When x = ir/6. 




(/r/6-0)(ff/6-Jr/j)^-jg/2) 

6 


I K St ff 

6 6 12 7 


= 0.02392, 


which agrees with the actual error in the solution obtained in example 3,16. 


3.9.3 Her mite's Interpolation Formula 

The interpolation formulae so far considered make use of only a certain 
number of function values. We now derive an interpolation formula in 
which both the function and its first derivative values are to be assigned at 
each point of interpolation. This is referred to as Hzrmite's interpolation 
formula* The interpolation problem is then defined as follows: Given the set 
of data points (x^ p y it yfX * = 1» ...» n* it Is required to determine a polynomial 

of the least degree, say /^n+lfcX such that 

H la+ i Uj) - y t ifijt+i (**) = y\\ i = 0. I - ■>(3-49) 

where the primes denote differentiation with respect to x. Hie polynomial 
/f in+ l(x) is called Hermile’s in te rpo tat km polynom ia L We have here [2n + 2) 
conditions and therefore tie number of coefficients to be determined is (2n + 2) 
and the degree of the polynomial is (In + 1). In analogy with the Lagrange 
interpolation formula (3.43), we seek a representation of the form 
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w Wi(*)=X i«Wy/+£ V ((*W* 

1=0 


(3.50) 


where «j(x) and v # (x) are polynomials in x of degree (2*1 + 1). Using conditions 
(3.49), we obtain 




1, 


0, 


if i = j 
if i * / 


w-(x) = 0, for all i; 


v^(i) = Os. for all i 




i, if i = i 
o, if / * / 


(3 51) 


Since h ( {jc) and ^(jc) are polynomials in x of degree (2n +1), we write 

u l (x)=A i (x) UO)] 2 and v,(i) = $(*) [/,(i)] J , (3.52) 

where Ifa) are given by (3.42). It is easy to see that ^(x) and Bfa) are 
both linear functions in x, We therefore write 


ufa) = {a t x + bf) {ifa)f and v,<x) = (c t x + d t ) {l fa)] 1 
Using conditions (3*51) in (3.53), we obtain 

<W+A =1 | 

Crt+<*i = 0j 

and 

a, + 2«*,) = G j 

c f = 1 .J 

From Eqs. (3-54), we deduce 

fl, =-2Tfa i ), b i =] + 2x i lfa t ) 


(3.53) 

(3.54a) 


(3.54b) 


(3 55) 


Hence Eqs. (3.53) become 

k,(i)-(-M( I( )+i+ wf 

-[1-2 (*-*,)(;(*)][/,<*)]* (3.56a) 

and 

v,W = (jf -x t )[lfa)f, (3J6b) 

Using the above expressions for ufa) and v,(x) in (3.50), we obtain finally 

n n 

ffjn + l00 = Y. (3,57) 

t=o f=e 

which is the required Hermits interpolation formula. 


Copyrighted m 


Presented By: http://www.ebooksuit.com 



Section 3,9: interpolation with Unevenly Spaced Points 


99 


The following examples demonstrate the application of Hercnite's formula. 

Example 3.20 Find the third-order Hermite polynomial passing through the 
points f- 0, I, 

Putting n = l in Hermite 5 s formula (3,57), we obtain 
#3 (*)=[1 - 2(* - J%) 4 (*o)] [/ot*)] 2 ya +P - 2 (* - xi ) Jf(*i )] (/, (x)f y, 

+(*-*a)IW*)] 2 y‘o +(*-*i)tt(*)] J ^. (i) 

Since 


/o(r) „±.3. = iZi and h(x)= ±Z*L = ^, 


where -X] -xp. Hence 


fie*)—-r ind ; JW=f 

fh ^ 


Then, (i) simplifies to 


,, 2(jr-Jto) 


1 , 2<Jfj -J) 

L * \ 


L *i J 




ft 


+ {X-x + (x-JT,) ^ y\, (ii) 

h l h \ 

which is the required Hermite formula. 

Example 3.21 Determine the Hermite polynomial of degree 5* which fits 
the following data and hence find an approximate value of in 2.7, 


X 

y - In t 

y=i/x 

2.0 

0.69315 

0.5 

2.5 

0.91629 

0.4000 

3.0 

1.09861 

0,33333 


The polynomials /j(jc) have already been computed in Example 3.15. These are 
l e (x) - lx 2 -1 lx +15, /, ( x) - ~<4x 2 - 20x + 24), l 2 (x) - lx 2 - 9x +10. 

We therefore obtain 

/J(jc) = 4x -11, f, r {x) = -8* + 20, fj (#) = Ax -9. 

Hence 

Iq(x o) = -3, ;|(J]) = 0, £(*,) = 3 
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Equations (3.56) give 
I^(X) = (6x -11) (lx 3 - \ lx +15} 2 , v 0 (x) = (x - 2) (2x 2 -11 jr +15) 1 

u,(x)>(4x 2 - 20 x + 24) 2 , vj(x) -(x- 2.5) (4x 2 -2Gx + 24)\ 

u 2 (x) = (19- 6x) (2X 2 -9x + 10) : p v 2 (x) = (x - 3)(2x z -9x +10)% 

Substituting these expressions in Eq. (3.57), we obtain the required Hermite 
polynomial 

(*) = (6* -11) (2** -11* +15) 3 (0.69315) 

+ (4** - 20* + 24) J (0.91629) 

+ (19 - 6i) (2I 1 - 9*+10) 2 (1.09S6!) 

+(*-2)(2* 3 -lUt+15) 1 (0.5) 

+ (*- 2.5) (Ax 2 - 20* + 24) 2 (0.4) 

+(*-3){2* J -9je+IQ) 3 (033333). 

Putting x s= 2-7 and simplifying we obtain 

In (2.7) * ifj (2,7) = 0,993252, 

which is correct to six decimal places. This is therefore a more accurate 
result than that obtained by using the Lagrange interpolation formula. 


3JO DIVIDED DIFFERENCES AND THEIR PROPERTIES 


The Lagrange interpolation formula, derived in Section 3,9.1, has the disadvantage 
that if another interpolation point were added, then the interpolation coefficients 
l f {x) will have to be recomputed. We therefore seek an interpolation polynomial 
which has the property that a polynomial of higher degree may be derived 
from it by simply adding new terms. Newton’s general interpolation formula 
Is one such formula and it employs what are called divided differences. It is 
otir principal purpose In this section to define such differences and discuss 
certain of their properties to obtain the basic formula due to Newton. 

L* 1 be the given (n + L) points. Then the 

divided differences of order 1*2* are defined by the relations: 


[*0, *,l“ 

x \ 

*2 "*0 


1 


(3.58) 


,, , , r fo .*2 .**]-[*<). *1 .* b -|] 
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Even if the arguments are equal, the divided differences may still have a 
meaning. We then set x, = ^ + s so that 

lim [jf 0t jf 0 + fl 

_ )im y(x®+£)-}<*{)) 

e 

- >(* 0 ), ^ X J ) i* differentiable. 


Similarly, 


(f'+l) afgJtWIfflte 

From (3.5S), it is easy to see that 


Again, 




y a 

Xq-X\ 


+ ^ = [*i,Jol 

X, -Jq 


(3 59) 


*a] = 

x 2 -x 0 


^2~>l 


BZM\ 

X|-xJ 


i 

h _V. 

! 1 1 

4 y* 

X 2~ X V 

y\ 

[_ x 2 - J l 

Xj-J, xj-x 0 J 



__ to- __ + _ ^ 

<*t» -X,)(x 0 -x 2 ) (x, -a&Maj-x 2 ) 

+■-^-. (3.60) 

(*2 -Xb)U 3 -*|) 


Similarly it can be shown that 


.*„] =- — -+-^-+ - 

+_ Zs. _. (3.61) 

(x„ 

Hence the divided differences are symmetrical in their arguments. 

Now let the arguments be equally spaced so that x ( = x 2 - x\ = — 

= x n - x 0-1 = A. Then we obtain 


[^,x,l = 21^1 = 1^ 
X| - x 0 A 


(3-62) 


■py righted materi 


Presented By: http://www.ebooksuit.com 



102 


Chapter 3: Interpolation 


*2 -*0 2n\ h h J 2h* fr2! 


and in general. 


h n! 


(3.63) 


(3,64) 


If the tabulated function is a polynomial of nth degree, then A n y$ would be 
a constant and hence the *rth divided difference would also be a constant, 

3,10.1 Newton's General Interpolation Formula 

We have, from the definition of divided differences. 


so that 
Again, 

which gives 


t-XQ 

y = y Q +{x-x 0 }{x r x ii l 

X-Xi 


[jc, Jtfl] = [jfo, Xj] + (x - XjJfjr, Xq, jq]. 

Substituting this value of [x*j$] in (3,65), we obtain 

y = y<\ + (* -x 0 ) I>o* J + {x- ) (* - X]) [x, jt(j, jc,]. 

But 

t „ - - - 

|X, Aj), X|, JPj,J — 

*“*2 

and so 

[l f Jfc, X,] = [X®> X u X 2 ] + (X - X2 ) [X, Xq , X,, Jfj], 

Equation (3.66) now gives 

y = ^ + (x-xo)[^,x,l + (x-io)(x-xi)[x 0 ,x],x 2 ] 
+ {x-x (i )(x-xi}(x-x 1 )[x,x 0 t x l ,x 2 l 

Proceeding in this way, we obtain 

y = >b + {x- xo) [x$, xj + (x - x 0 ) {x-X \) [x 0 . x \ i %3 

+ (x - x^ ) (x -xj) (x-x 2 ) [xq, x 5 ,x 3> x 3 ] + ■ ” 


(3-65) 


(3,66) 


(3.67) 


(3.68) 


(3,69) 
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Hi is formula is called Newton's general interpolation formula with divided 
differences t the last term being the remainder term after (n +1) terms. 

Example 3.22 As our first example to illustrate the use of Newton's divided 
difference formula, we consider the data of Example 3.13. 

The divided difference table Is 


* toOto* 


300 

2,4771 

0.00145 


304 

2.4829 

0.00140 

o.ooooi 

m 

2.4843 

0-00140 

0 

30 1 

2,4871 




Hence Eq, (3.69) gives 

iog 3C j301 = 2.4771 +0.0€ 145 + (-3)(-0.00001) = 2.4786, as before. 

It is clear that the arithmetic in this method is much simpler when compared 
to that in Lagrange's method. 

Example 3.23 Using the following table find f(x) as a polynomial in x. 


X 

/<*> 

-l 

3 

0 

-6 

3 

39 

6 

822 

7 

1611 


The divided difference table is 

X f(x) 




-e 



0 

-6 


6 




16 


5 

3 

3i 


41 




261 


13 

6 

822 


132 




780 



7 

1611 





Hence Eq. (3.69) gives 

/(jr) « 3+(x+1) (-9)+x(jt+1) (6)+jc(x+1)(x-3) (5)+jc(x+ I)(x-3) (x-6) 
= jt 4 - 3* 3 + 5* 1 - 6. 
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3,10,3 Interpolation by Iteration 

Newton's general interpolation formula may be considered as one of a class 
of methods which generate successively higher-order interpolation formulae. 
We now describe another method of this class, doe to A.C. Aitken, which 
has the advantage of being very easily programmed for a digital computer. 

Given the (n + 1) points Oqj* »»(*«• JbX where the values 

of x need not necessarily be equally spaced, then to find the value of y 
corresponding to any given value of x we proceed iteratively as follows; 
obtain a first approximation to y by considering the first-two points only; 
then obtain its second approximation by considering the first-three points, 
and so on. We denote the different interpolation polynomials by A(r), with 
suitable subscripts, so that at the first stage of approximation, we have 


%£*) = To + C* - *d) [*b. x i ] = —— 

x \ "*o 


To 

n 


XQ-X 
*1 - X 


Similarly, we can form A^UX A^OcX*- 

Next we form A 011 by considering the first-three points: 


Aou(x) 


1 

*2™*t 


Aoi Of) 

A^C*) 


*i ~ x 

X2 -Jf 


(3.70) 


(3J1) 


Similarly we obtain A 0 j 3 (jcX A 0 ^(x) s etc. At the nth stage of approximation, 
we obtain 


The computations may conveniently be arranged as 
Table 3.7 Altken'a Scheme 


Ac 12-■■!»(*) = ■ 


1 


*W “**-1 



(3.72) 


x„-x| 

m Table 3.7 below: 


X 

¥ 




X 0 

To 

*oi M 



*1 

X\ 

Aceix) 

Aoist*) 

*0123W 

*g 

¥2 


AoisW 

*01 234 W 



A©gM 


AoiZ*M 

*3 

/3 


*014( x ) 


*4 

¥4 





A modification of this scheme, due to Neville, is given in Table 3.8. Neville's 
scheme is particularly suited for iterated inverse interpolation. 
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Table 3>8 Neville*© Scheme 


X 

y 




*0 

yo 

AmW 




ys 

iia(Jf) 

^012(*) 

40123^) 

x 2 

Yz 



&Q1 234(A) 





A 123*( Jf ) 

*3 

>3 

AwW 

A 234M 


*4 

Y4 





As an illustration of Aitken’s method, we consider, again, Example 3,22. 
Example 3.24 Aitken's scheme is 


Jf 


300 

2,4771 

2,47855 


304 

2.482§ 

2,47858 




247854 

2.47880 

305 

2,4843 

2.47857 




2.47853 


307 

2.4071 




Hence log] ^ 301 = 2,4786, as before. 

An obvious advantage of AitkerTs method is that it gives a goad idea 
of the accuracy of the resuk at any stage , 

3,11 INVERSE INTERPOLATION 

Given a set of values of * and y , the process of finding the value of x for 
a certain value of y is called inverse interpolation. When the values of x are 
at unequal intervals, the most obvious way of performing this process is by 
interchanging x and y in Lagrange's or AitkerTs methods. Use of Lagrange’s 
formula was already illustrated in Example 3.14. We will now solve the 
same example by means of Aitken s and Neville's schemes, 

Aitken’s scheme (see Table 3,7) is 


y 

X 



4 

1 





1.750 


12 

3 


1.857 



1.600 


19 

4 
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whereas Neville’s scheme (see Table 3.8) gives 

y *_ 


4 

1 





1.750 


12 

3 


1.857 



2.286 


19 

4 




Hence both the schemes lead to the same result ultimately. In practice, 
however, Neville's scheme should be preferred for the simple reason that In 
this scheme those points which are nearest to x r are used for interpolation 
at r = It Is, of course, important to remember lint inverse interpolation 
is, in general, meaningful only if the function is single-valued in the interval 
When the values of x are equally spaced, the method of successive 
approximations, described below, should be used. 

Method of successive approximations 

We start with Newton's forward difference formula [see Eq. (3.10), Section 3.6] 
written as 


a, «{« -1) * 2 U (u -1) {l* - 2) 4 3 

y* = yn +wAvo + ■■ Ay 0 +——+ * 


(3.73) 


From this we obtain 
1 


ir« 


L 


u{v-1),2 U(U-\)(U-2 ),J 1 

y*-yo —— 1 — f —U 


.74) 


Neglecting the second and higher differences, we obtain the first approximation 
to zi and this we write as follows 


“i=T-(y.->o)- (3.75) 

Next, we obtain the second approximation to u by including the term containing 
the second differences. Thus, 

<■■*> 

where we have used the value of «| for w in the coefficient of & 2 y 0 . Similarly, 
we obtain 
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and so on. This process should be continued till two successive approximations 
to it agree with each other to the required accuracy. The method is illustrated 
by means of the following example. 

Example S.2S Tabulate y - t 3 for x = % % 4 and S f and calculate the cube 
mot of 10 correct to three decimal places, 

x y=x* A A 2 A 3 


2 8 

3 27 

4 64 

5 125 


ip 

37 

61 


18 

24 


6 


Here y u -10 , y 0 =8, = 19, =18 and A 3 y 0 = 6. The successive 

approximations to w are therefore 


C2>-0.1 

19 1 2 


(m 



1 r, 0,15(0*15-1)^ 0.15 «U5-1) (0.15-2) 
2 -;- -{it )——■ — — ■■ 


19 


u 4 -— 
4 19 


^ ^ 19 


( 6 ) 


= 0,1532 


„ 0,1532(Orl532-!) 0.1532(0.1532-1)(0.1532-2) ,, s 

2---(18)----(6) 


* 0,1541(0,1541-1) 0,l54l{(M541-])(0,i54i"2) 

2 ---(Is)-;-(6) 


= 0,1541 


=0.1542. 


We therefore take u =0.154 correct to three decimal places. Hence the value 
of x (which corresponds to y =1 OX he. the cube root of 10 is given by 
*0 + 1^=2,154. 

This example demonstrates the relationship between the inverse 
interpolation and the solution of algebraic equations. 


3.12 DOUBLE INTERPOLATION 

In the preceding sections we have derived interpolation formulae to approximate 
a function of a single variable. For a function of two or more variables* the 
formulae become complicated but a simpler procedure is to interpolate with 
respect to the first variable keeping the others constant* then interpolate 
with respect to the second variable* and so on. The method is illustrated 
below for a function of two variables, For a more efficient procedure for 
multivariate interpolation* see Section 3,15. 
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Example 3.26 The following table gives tie values of z for different values 
of x and y. Find z when x *= 2.5 and y = 1,5* 


x 


y 

0 

1 

2 

3 

4 

0 

0 

1 

4 

9 

16 

i 

2 

3 

6 

11 

1ft 

2 

6 

7 

10 

is 

22 

3 

12 

13 

18 

21 

2ft 

4 

18 

19 

22 

27 

34 


We first interpolate with respect to x keeping y constant. For x = 2.5* we 
obtain the following table using linear interpolation. 


y * 


0 

6.5 

i 

8,5 

2 

12,5 

3 

18.5 

4 

24.5 


Now, we interpolate with respect to y using linear interpolation once again. For 
y = 1 -5 t we obtain 

,,*11221 = l0 .s 
2 

so that z(2.5* 1.3) = 10.5, Actually, the tabulated function is z-x 2 +y 2 +y 
and hence z(2.5, 1.5) = 10.0, so that the computed value has an error of 5%. 

3.13 SPLINE INTERPOLATION 

We have so far discussed methods of finding an nth-order polynomial 
passing through (n +1) given data points. Because of round-off and systematic 
errors, these polynomials were found to give erroneous results in certain 
cases. This is particularly so when the function undergoes sudden changes 
m the vicinity of a point in its range. Further, it was found that a low order 
polynomial approximation in each subinterval provides a better approximation 
to the tabulated function than fitting a single high-order polynomial to the 
entire range. These connecting piecewise polynomials are called spline functions, 
named after the draftman's device of using a dun flexible strip (called a 
spline) to draw a smooth curve through given points. The points at which 
two connecting splines meet are called knots. The connecting polynomials 
could be of any degree and therefore we have different types of spline 
functions, viz,* linear, quadratic* cubic, qtuntic, etc. Of all these, the cubic spline 
(spline of degree three or order four) has been found to be the most popular 
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in engineering applications. We shall* however* start with a discussion of 
linear and quadratic splines, since this would set the theme for the derivation 
of the governing equations of the cubic spline. 


3.13.1 Linear Splines 


Let the given data points be 




where 


'"0, 1* 2 * s * T| n* 


and let 


a-Xfi <*| <x 2 <^<x„=b 


(3.78) 


^ = /=1,2,„» i a (3,79) 

Further* let ^(jc) be the spline of degree one defined in the interval (x M . X, ]. 
Obviously, s t (x) represents a straight line joining the points and 

(x ft y'i). Hence* we write 

+fft({x-^_i), (3.80) 

where 

m , = a~it±. (3.8i) 

f-l 

Setting i = l* 2, « successively in (3,80), we obtain different splines of 

degree one valid in the subintervals 1 to n, respectively. It is easily seen 
that is continuous at both the end points. 

Example 3.27 Given the set of data points (1* -8) <2* -1) and (3*18) satisfying 
the function y = f{x\ find the linear splines satisfying the given data. Determine 
the approximate values of y(2,5) and y'(2.0). 

Lei the given points be .4(1, - 8), 0(2, -1) and C(3 : 18). Equation of AB is 

= -8 + (x -1)7 - 7jc -15* 

and equation of BC is 

j 2 (x) = “1 + (*-2)19 = 19*-39. 

Since x = 2.5 belongs to the interval [2*3]* we have 

>(2,5) ® ^(2,5) = 19(2,5) - 39 = 8,5. 
and 

y , (2ti)*m [ = 19. 

It is easy to check that the splines jj(jr) are continuous in [1*3] but their 
slopes are discontinuous. This is clearly a drawback of linear splines and 
therefore we next discuss quadratic splines which assume the continuity of 
the slopes in addition to that of the function. 
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3,13.2 Quadratic Sprites 

\ 

With reference to the data points given in (3.78), let ^(x) be the quadratic 
spline approximating the function y = /( jc) in ttie interval {x^^xj, where 
x t~ x i-i = J V I/(jc) and jJ(x) be continuous in [x^x,,] and let 

*iW s y ir i = 0,1,2.n, (3,82) 

Since Sj(x) is a quadratic in [jcj_|, x^] T it follows that $|{x) h a linear function 
and therefore we write 


jf{*)=r Vn " x ) m t-i + (* ■- *(-t) m f ]* 

fti 

where 

m t •a}(x i y 

Integrating (3,83) with respect to x, we obtain 

(r.-jc) 1 (x — jc,_. ) 2 

i _ . , < .. . JH ._ ] + i - 


Site ) = -r 




+ c t , 


(3.83) 


(3.84) 


(3,85) 


where c t are constants to be determined. Putting x - x M in (3.85), we get 

1 h, 

= yi-\ + j— «i-i= yi-i +- ™ ( -i ■ 

Hence (3.85) becomes: 




tei-xf _ . te-Xf-if 






+ J/ M (3.86) 


In (3.86), the iWj are still unknown. To determine the m h we use the condition 
of continuity of the function since the first derivatives are already continuous. 
For the continuity of the function s f (x) at x-x f w& must have 

*f(*f-) = *N-|(*J+) ( 387 ) 

From (3J6) t we obtain 


JL t 

J, {Xj -) = — U7 ( 4 y H | + -« M 

hi 

= y(*Vl +"*i> + J ? .--h 


(3,88) 


Further, 


W*)=T— 

Vl 


(a±i-*)* , («-*>* 

#1 T ^ 


■«i+i 


v m 

\>7 + ~ m ^ 
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til 


and therefore 


s M( x i + )=-^Y‘”i*yi + ^Y if ‘i=yf ( 3 - 8S > 

Equality of (3,88) and (1,89) produces the recurrence relation 

2 

m M + m t =— {y t ~y^% i = 1, 2, n (3,90) 

*h 

for the spline first derivatives m,. Equations (3,90) constitute n equations in 

(fl + 1) unknowns, viz, «Q ( mj.m*, Hence, we require one more condition 

to determine the uniquely. There are several ways of choosing this condition. 
One natural way is to choose ) = 0 t since the mechanical spline straightens 
out in the end intervals. Such a spline is called a natural spline. Differentiating 
(3.86) twice with respect to jr, we obtain 

«j)“—(-^Vi 

K 

or 

J i'(*t)=irO n i _m o)* 

Hence, we have the additional condition as 

%=*»!■ (3 91) 

Therefore, Eqs. (3.90) and (3,91) can he solved for which when substituted 
in (3.86) gives the required quadratic spline 

Example 3.28 Determine the quadratic splines satisfying the data given in 
Example 3.27. Find also approximate values of y^2.5)and j/(2.G). 

We have n c 2 and h s |. Equations (3,90) give 

nig + «14 and iw t +/w 2 =38. 

Since ni{> = «,, we obtain mo =m i =7, and =31. 

Hence, Eq, (3,86) gives; 

J2W= -C^ (7)+ rf (31M+ z 


( 3 ~xl* 

2 


<7}+^C*-2) 3 


5 

+ — 
2 


= 12^-411 + 33, 

which is the spline in the interval [2, 3], 

Hence, 

y(2.5) * ^(2.5) = 5.5 and /(2,0}*7,0, 
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The quadratic spline ^(je) in the interval fl, 2] can be determined in a similar 
way. A straightforward way of deriving the quadratic splines is as follows: 
Since s&x) is a quadratic in (jr M ,XjX w * write 

5 i (j) = a / + ^x + c f x 3 , (3.92) 

where a h b t and c ( are constants to be determined. Clearly, there are 
constants and therefore we require 3n conditions to determine them. These 
conditions are obtained by using tie properties of tie quadratic spline. Firstly, we 
use the condition that the spline passes through the interior points. This means 

= ^ +^j +c t xf i = l # 2 t „.,u-l. (3.93) 

Next, sfyt) is continuous at x - Xj. This condition requires 

^(j r ) = ^ + ,(^+>. (3.94) 

Hence, we must have 

o, + £,*/ =^ +l + fy + , Xt +Cj4. } x? t * = Lp2,n-1- (3.95) 

Again, jJ{jc) is continuous at jr=x / .This gives 

b t + 2c i x i =b M +2c M x lr / = L 2, ,,, T n-1, (3,96) 

We thus have 3n-3 conditions and we require three more conditions. Since the 
spline passes through the end points also, we must have 

y0=tfi+Vo+*l*i} (3-97) 

and 

= + ( 3 - 98 ) 

Finally, for the natural spline, we have 

*fte) = 0> (3,99)1 

and this gi ves 

q=(h (3.100) 

We have thus a completed system of 3 n equations in 3u unknowns. Although this 

system can certainly be solved, it is obviously more expensive and therefore 
this method is less preferred to the previous one. 

The discontinuity in the second derivatives is an obvious disadvantage 
of the quadratic splines and this drawback is removed in the cubic splines 
discussed below. 

3,14 CUBIC SPLINES 

We consider the same set of data points, viz,, the data defined in (3.78} t 
and let s t (x) be the cubic spline defined in the interval [x M ,jq). The conditions 
for the natural cubic spline are 
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( 1 ) Sf{x) is almost a cubic in each subintervaJ [x,_|, xj, i-1, 

(ii) # = 0 , 1 , 2 *. 

(ill) s,(xhjf(;c) and s"(x) are continuous in [xq, x*], and 
0v) slXx 0 ) = s , i Xx H ) = 0. 

To derive the governing equations of the cubic spline, we observe that the 
spline second derivatives must be linear. Hence, we have in [x M ,x,]: 

*"(*) ~ 7 -[(*, “ *Wt _| +(x- Xi_ } Wi], 0 101 ) 

where h,-x f -x M and ^'(x, )-M t for all 1 .Obviously, the spline second 
derivatives are continuous. Integrating (3,101) twice with respect to x, we 
get 



fa-*) 3 

6 


K-I 


+ 


t ) 3 

6 



+ c i (x i -j) + c^(jr-x M)T 


(3,102) 


where c f and d i are constants to be determined. 

Using conditions and = y lt we immediately obtain 


c t = ■ 


1 


V 


I 


.2 1 




(3.103) 


Substituting for c, and ^ in (3.102), we obtain 






M(+ 




V „ 
* ‘7 M| 




(3.104) 


In (3,104), the spline second derivatives, M iy are still not known. To determine 
them, we use the condition of continuity of s'(x). From (3.104), we obtain 
by differentiation: 



6 


M, 


3(x - X(_i y 


/-I 
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Setting x = je, in the above, we obtain the left-hand derivative 




-~^->w)4«h4m 0=1.2. .7,). (3.105) 

ftj b 3 


To obtain the right-hand derivative, we need first to write down the equation 
of the cubic spline in the subinterval (x J+ jr, +] >, We do this by setting j=j'+ 1 
in Eq. (3,104) 


1 


Vi 

6 


H+i +1 / f ——Mi (* i+ , - x) 


vm ~~ m m <*-*) - 


a me) 


where k i+ 1 =*,+ ^-x r Differentiating (3,106) and setting x - x h we obtain the 
right-hand derivative at x = jq 

-*>- (/=0,t . n ~ n (3107) 

Equality of (3.105) and (3.107) produces the recurrence relation 

^yM-VL_hZJ!H. (1 = 1,2,...,n-L). (3.108) 

For equal intervals* we have h i ^ h i+} - h and Eq. (3,108) simplifies to 


M h + 4M { + M i+1 - ^(y M -2y t + y lA )> d = I, 2. ^ (3A09) 

The system of Eqs. (3.108) has some special significance. If Af c and M n are 
known, then the system can be written as 
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2(^ +*2 Wt +*hM 2 -6| p 

h *1 J 


-h,M 0 


| + 2 fa +^^2 + Aj Af* - 6 


L Aj *3 J 




>'4"^j > r 3“> r 2 

l h* k 


(3.U0) 


V,m b _j + KVi+*. )«,-,=«s( 

Equations (3.108) or (3.109) constitute a system of (n- i) equations and 
with the two conditions in (iv) for the natural spline, we have a complete 
system which can be solved for the M Systems of the form (3.110) are 
called, tridiagoml systems and in the Ch. 6, we shall describe an efficient and 
accurate method for solving them. When the M f are known, Eq. (3.104) 
then gives the required cubic spline in the subinterval [ij_|, jJ. Also, the y' can 
be obtained from Eqs. (3.105) and (3.107). 

Example 3«29 Determine the cubic splines satisfying the data of Example 3-27, 
Find also the approximate values of y(2.5) and y\2 .0). 

We have 2 and - A/ 2 = 0. Hence, the recurrence relation (3,109) 
gives M\ =18, If 3i(x) and j 2 (jr) are, respectively, the cubic splines in the 
intervals 1 £ x £ 2 and 2 £ x S % we obtain 

and 

s 2 {x) = 3(3-x) 3 +22x^48. 

We therefore have 

X2.i)^,aS) = 1 + 7 = 7.375 
and 

/(2.0)*jj(2.0)-I3+0- 

It should be noted that the tabulated function is y=?j 3 -9 and hence the 
exact values of y{2.5) and y'(2.0) are, respectively, 6.625 and 12.0. The 
convergence to the actual values, with the increase in the order of the 
spline, is dearly seen from examples 3*27,3.28 and 3,29. In many applications, it 
will be convenient to work with the spline first derivatives. Denoting #}(*,) - m, 
and taking suitable combinations of Eqs. (3.105) and (3.107), we can derive 
the following relationship for the m t : 
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I 




\ 

M f + 

J 


*f + | 


«/ + l 


“4-Ov+i -^>+-4^ i-1,2,^.,11-1. (3.111) 

The cubi c spline in (Jr*,* , ,t r ) in terms of the m, is then given by 

l 1 T 

-j)> 

A f 

+ TjO'M^-*)+*]}■ (3.112) 

*r 


The above result can easily be derived using the Hermite interpolation formula 
given in section 3.$.3. 

For equally spaced knots, Eqs. (3.11J) assume the simpler form: 

««+*»/+<**i=|0Wi-J'i-i>. ;=i,2.a-i. (3.U3) 


Equations (3.109) or (3, 113) constitute (n- 1 ) equations in (n +1) unknowns, 
viz,, %, JW] ,,, t iw w * Clearly, two further relations are required in order that 
a unique interpolating spline may 3% found. These conditions are called the 
end conditions and are discussed in detail in Kershaw [1971, 1972). The 
following example demonstrates the improvement in accuracy of the cubic 
spline interpolates with successive interval halving, 

Example 3.30 Given the points (<X 0),(jr/2,1) and (?f,D) satisfying the 
function y - sin x (0 £ x £ jf), determine the value of y (m/6) using the cubic 
spline approximation. 

We have n = 2 and h == jt/ 2. The recurrence relation for the spline second 
derivatives gives: 


+ 4MJ + Af 2 = ^(Q - 2 + 0) =--if, 

7T 71 

For the natural spline, we have =0. Hence, we have 



In the interval [ 0 , ft/2], the natural cubic splint is given by 



2r 3 
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Hence 

'(C-'S-KtHW'* 

We next take h - nf 4* i,e< tie data points are (0, 0% {xt4 r ltJ%% (jt/2,1), 
(3jz/4, 1 /V5) and 0). In this case, the recurrence relation gives: 


4M^Mj =- 4.029 


A/,+4Af 2 + Ar 3 ^ -5,699 


(i) 


M 2 +4Ms =- 4 . 029 , 


since Af 0 = A/ 4 = 0. Solving eqs. (i), we obtain 

Af, - -0,7440, M t * -1.053, M 3 = -0.7440, 

In 0 £ x £ jt/4 t the cubic spline is given by 

s y {x) = - |-0.1240(jr 3 ) + 0.7836 {jc)]. 

7t 

Hence, 

'(£h(f )= 0499 ®- 

This result shows that the cubic spline has produced a better approximation 
when the interval is halved. We finally consider values of v • sin r in intervals 
of 10 fl from j = 0 to # and then interpolate for x = 5 d , 15* T 25*, 35* and 
45®* using the natural cubic spline. The cubic spline values together with the 
exact values are given in the following table; 


y« aki x 


x (in degrees) 

Cubic spline values. 

Exact values 

5 

0.007155743 

0,087155530 

15 

0^58619045 

0.258618415 

£5 

0.4226182(32 

0,422617233 

35 

0.573576436 

0.573575040 

45 

0.707106781 

0.707105Q59 


3*14.1 Minimizing Property of Cubic Splines 

We prove this proper^ for the natural cubic spline. Let s (*) be the natural 
cubic spline interpolating the set of data points (x h yi), i = 0 t L X n» where 
it is assumed that a = < x l < x 2 < <•* < x n = b. Since s{x) is the natural cubic 

spline, we have s(x t ) = y f for all i and also = ?"(**) =0. 

Let z{x) be a function such that y t for all i, and x(x) t zXx), s'X x ) 
are continuous in [n t b]. Then the integral defined by 
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/* fV’Wl 2 * (3-114) 

will be minimum if and only if e(jc) ■ s(j). This means that j(j) is the 
smoothest function interpolating to the set of data points defined above, 
since the second derivative is a good approximation to the curvature of a 
curve. We write 


f (/'(*)]*(&= f [*"(*)+*"«-»"W] 2 * 

Ja Ja 

=■ J Vto 2 * + 2 JV<*)[*"<*) - *"(*)]* 

Jfl 


(3,115) 


Now, 


f s'xx)[*"(x)-*"cx)]A=y r’V(<x*"(*>-j"(*)j<* 
Ja to 

n-l 

=£<*'’{*)[*’<*)- A*)]} *•' 


f=0 


*r*1 


^(xftzXxy-sXxfidx. (3.116) 


-5*. 

Hie first term in (3.116) simplifies to 

SXXnMiXn) ~ A*m)] “" A*o)l 

Since /'(>>,) = r‘ r (^> - 0, the above expression vanishes. Similarly, the second 
term in (3.116) is zero since has a constant value in each interval and 
<x j ) = 2 (^) = yi for all U Hence, (3.115) becomes 

jW>f*= |Vwf<*+JV'W-J’WI 1 ** (3.117) 


or 


J Vt*)] 2 ** (W)] 1 *- 

It follows that the integral 

/= fVwf* 

Jq 


(3118) 
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will be minimum if and only if 


m 


f° [z" 0 r)-^(x)] J <b= 0 , ( 3 . 119 ) 

J b 

which means that C(x) = s tf (x). Hence z(x} - s(x) is a polynomial in x of 
degree at most three in [a, &]* Bat the difference zU) - j(jc) vanishes at the 
points r =0,1,2. n. It therefore follows that 

z(*) = *(*), aSx %b. 


3.14.2 Error In (he Cubic Spline and Its Derivatives 


An estimation of error in the cubic spline and its derivatives will be useful 
in practical applications. 

The natural cubic spline yields a good approximation of a smooth function 
together with several derivatives, which is testified by the following theorem: 

Thmr^m 3*1 If y€c 3 [d,£] t a = %<jC| <X 2 < -<x n = &, and if s(x) is 
the natural cubic spline for which 

i- 0 p i 2 , ,..,n 

then 


where 

and 


max |yU)-JU)|^Mr, <3120) 

h ~Xi H i = 0, 1, % n 


M =maxjy"fj>| T jt<j £ *£ jc fl . 

It is clear that as the interval length k becomes smaller the better approximation 
the spline gives. This is in contrast to the known peculiarities of Lagrange 
interpolation. The errors in the spline derivatives can be obtained by using 
the operator notation. To find the errors in the first derivatives, we start 
with the recurrence relation (3.113), viz. T 


That is, 


«(., + 4n% + m, + , = -(J M - ). 


j'(Xi_,) + 4j'(jii)+s'<x jfl ) = |(> w - y,_, >- 
Using the operator notation, the above equation can be written as 


<£-> + 4 +£) s\ti) = ~(E - tr'tyt. 
h 


<3,121) 
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Since Em J*®, where (3.121) becomes 

{e -*0 + 4 + *»*&) - !<*" - e-* 0 )^. (3.122) 


Now, 


and 


Hence 


and 


u> 1 L ,V h1 ^ A 3 ^ 3 k 4 D* h i D i 

e =\ + hD+ ■■■ — +——+-+-+ •■ 

2! 3! 4! 5! 


2! 3! 4! S! 


e u > +e - M> = 2 


(. h 1 !? k 4 D* A S D* 

N- . +-—— +- 

2 24 220 


JtD -hD 
e 


f A’O 1 A S fl S 

= 2 hD +-+-+ ■■ 

l 6 120 J 


Using the above expressions In (3.122), we obtain 




6 + 120 




A i 0 1 h A D- \ 

-6 D + - - +—«-r 

6 120 




The above equation simplifies to 

v 6{Z) + A 1 D 3 /6 + A 4 Z) 5 /120 + * ■■) D + tfnPfS + h^D 5 / 120 + — 

j{*;)* —_ .nr.. ' - " X- : >f 


6 +A 5 1? + A 4 D 4 /12+-* 


1 + A 1 D 2 A5 + A 4 D*/72 + - ■ 


i-pMH 




f a 4 £> 4 3 

2 

| r T 

l 6 72 2 



J'i 
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n h 2 L? h*E? 

6 120 

V 

A 1 /) 3 h A rf 
D +-+ ——- + ’ 


^ k 2 !? h*D* | h A jf j ) 

6 " 72 ~”’ + 36 + ‘ 


V 


120 


If. ^Z? 2 h 4 P* \ 

I 1 —*—"> 


f n Co 3 aV a 1 !* 3 aV aV 1 

D -—+ —-+ —- -+—TT- + -\y. 


72 


36 120 




Hence 


y t 


-[5q*V +°(* 6 )- 


(3.123) 


in a similar manner, we can derive the relations: 

*"<*( )=>"<*( )“AV (*,)+“*V(*, )+<XA«) (3.124) 
J 2 joU 

(s'"(*,+)+j"'(* i -)]-y w (i ( )+^A I /(4i)+0(* 4 ). (3.12S) 

!'•'(*,+) - =A/'Ot ,) - ^ AV” (*,) + OCA 7 ). (3.126) 

From(3.123)to(3.126),we obtain 


y(*iW(*f)+0(A 4 ) (3.L27) 

y'(xJ = i’'(* ( ) + ^AV , {* ( ) + 0(A 4 ) (3,128) 

>"'(*,) = i[ S '"(i,+) + ^’Ct,-)]+0(A*) (3.129) 

/txa=|ti"’(^+)-j"'(*r)] + 0(* 4 )- (3.130) 


Relations (3.l27)-(3.130) demonstrate that we can approximate 
and more accurately than /"<*,)* and this fact will be useful in the 

solution of differential equations with given boundary conditions. The above 
relations are due to Curtis and Powell (1967]. 
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3.15 SURFACE FITTING BY CUBIC SPLINES 


The cubic splines derived in the previous section can be extended to functions 
of two or more variables. We derive the formulae for functions of two 
variables! the extension to higher dimensions being straightforward,* Let 
!,{*) be natural cubic spiitm which satisfy 


Lt{Xj) = Sy * L, j = i i 

-0^ j*L / 


(3.131) 


These spikes bear the same relation to the general cubic spline as the 
Lagrange polynomials bear to the Lagrange interpolation polynomial. Due to 
this reason, we call them cardinal splines. Let j(x) be the natural cubic 
spike, in Xj^ £ corresponding to the set of data points (xj^ yj), 

y-0, h 2, Then, Lf{x) are the cardinal splines corresponding to the 
set of data points {x^ t S k where S ( j is the Kronecker delta defined above. 
The cardinal splines are given by 




(xi-x)* { h 2 \ 

~ m >.h + —ijp-Vw 


+ (x ~ X, |) 






(3 132) 


where = x^). It is easy to verify that (3.132) satisfies conditions 

(3.131). As in the case of general splines, the condition of continuity of the 
first derivatives leads to the recurrence relation 


M '.n+ AM UJ + M I.M = ~ 2S U + s ur l)- 0-133) 

In terms of the cardinal splines i^fx), the general spline sfx), in the 
interval jcy_| can be written as 

M 

j(i) = £ (3-154) 

i&G 

where ^(x) are gfyen by (3.132). 

Extension to functions of two variables is now quite straightforward. 
Let the values 

i' = 0, 1, 2, n 

of a function of two variables, z = /{x, be given at the n 2 data points 
arranged at lie intersections of a rectangular mesh. The interpolation problem 


*See> Ichtda and Kiyono [1974] 
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m 

now is to determine the value of z at an arbitrary point in the rectangular 
region. The cubic spline formula is given by 

*(*. y )=X X AMf/M hr ( 3 - 135 ) 

1=0 /VO 

where L^x) and Lj(y) are given by formulae of the type (3,132). The spline 
second derivatives, M$ y are calculated from the recurrence relation (3.133) 
by imposing the natural end conditions, M { $ = M f n *=Q. 

The following examples demonstrate the use of the formulae derived 
above. 

Example 3*31 Using the data of Example 3.27, viz., (1, -6), (1,-1) and 
( 3 „ 1 g), find the cardinal splines L f ( x) and hence determine the general natural 
cubic spline in the interval I £ x £ 2, 

For the interval 2* we have j = 1. With h = 1, and j = 1, Bq, (3.132) 
gives: 

4(*> = o + +(2-*)(<?/,0-^H.o] 

+(r-l)U,-i« u ) 

“~^U+( 2 -*)^,o+(*-l)fa u -jJffcjj. (i) 

since M l 0 = 0 for the natural cubic spline. 

Similarly, the recurrence relation (3.133), becomes: 

4M ik | = 6 (£ (i u - 25; | + 6; 

from which we obtain 


Af G i=-, Af l ^ ] =-3 > 

Hence, (i) gives: 

M 2 , =-. 

2,\ 2 


w = C* 6 lfj'3j +{2 _ i)+(i _ ,) ^l 

\ l, 5 9 

Oi) 



(Hi) 

4 4 


(iv) 


Hence, in 2, the general natural cubic spline is given by 
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2 

s(x) = '£y l l i M 

f=0 

= 3(i-l)’+4i-a 

which is the same as that obtained in Example 3.29. The next example 
demonstrates the use of cardinal splines in surface fitting. 

Example 332 The function z = f(x, y) satisfies the following data for 0 % x t 
y :£ 2, Determine the natural cubic spline s(x, _y) which approximates the 
above data and hence find the approximate value of z(0,5, 0.5). 


^012 
0 12 9 

1 2 3 10 

2 9 10 17 

For determining *(0*5,0.5), we need to obtain the natural cubic spline 
for the Interval Q £ x, y £ 1. 

With h = 1, j = 1, we have 


J, WI+(l -x) ($. 

= j M u +CI-*)A,0 + *(<*/. 1 |j. 

since Af it o- 0 for the natural cubic spline. Also, 

Hence, we obtain 

A4,i=f * «2.I =5 

From eq. (i)* we then obtain 


, j . x 5 5x , 

4W= _._ +l , 


<>) 
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ZaOf)-!**~* 

4 4 

Hence, in 0 < x, y£ 1, we have 
2 2 

i ¥ (x)I / (y)i ty 

t=Q y=o 

*= A>(*) [A(r)*c,c + k(y)h. i + At 0>^il 
+AC*)[JpO'H& + 4CvHi + AiOO^il 
+A(*)(AO')^o+ACxteu + A 0)^,2 3- 


Since x = y = 0.5, the above equation gives: 
z(0.5 p 0.5) «s (0*5, 0,5) 


32 U 2 16 32 J 16^32 16 32 

3 r 13 11 3 

-— jc94™5(]0__5(]7 

32^32 16 32 J 


- 0875, 

The tabulated function is z = jt 3 + y 3 +I and therefore the exact value of 
x(0,5,0.5) is 1.25, which means that the above interpolated value has an 
error of 30%. 


EXERCISES 

3.1* Form a table of differences for the function /(*) ^ jt 3 + Sx —7 for 
r = -l, 0, l, 2, 3, 4, 5. Continue the table to obtain /( 6 ) and /(7)* 
3*2. Evaluate 

(a) aV (b) A 2 (co$x) (c) A[(jc+L)(x + 2 )] 

(d) A(tm~ l x) (e) 4 [f(x)tg(x)l 

3*3* Locate and correct the error in the following table of values: 


X 

y 

2*5 

4.32 

3.0 

4.83 

3.5 

5.27 

4.0 

5.47 

4*5 

6.26 

5.0 

6.79 

5.5 

7.23 
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3,4 Prove the following: 

(a) u x = + Au x _ 2 + A 2 ^ + ■■■ + A^ 1 ^ + 

(b) A ”y x = ^ +I1 +"CiJw a - + H>" 

(o) u, + Uj + ■ >*+ « n =*Cj«q +"£2^ +"■ + A"~ V 

3.5. From the following table > find the number of students who obtained 
marks between 60 and 70; 


Marks obtained 

No. of students 

0-40 

250 

40-60 

120 

60-80 

100 

80-100 

70 

100-120 

50 


In the following table, the values of y are consecutive terms of a 
series of which the number 31 is the 5th term, find the first and 
the tenth terms of the series. Find also the polynomial which 
approximates these values: 

X 

_y__ 

3 

13 

4 

21 

5 

31 

6 

43 

7 

57 

8 

73 

9 

91 

From the following table of values of* and/(x), determine (i)/{0.23) 
and (U) /(Q.29); 


X 

/(*) 

0.20 

1.6596 

0.22 

1.6698 

0.24 

1.6804 

0,26 

1.6912 

0,28 

1.7024 

0.30 

1.7)39 


3.8* Find the 7th term and the general term of the series 3, 9, 20, 38, 
65, ... 
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3.9* The fallowing values are taken from the table of cubes: 


X 

y-* 5 

6.1 

226.981 

6.2 

238*328 

63 

250.047 

6.4 

262J44 

6.5 

274.625 

6.6 

287.4% 

6.7 

300.763 

Find (6.36) 3 and {6.61) ! . 


3.10* Define the operators, and£, F -1 and show that 

(i) A * £V 

(il) V = E^ A 

{iii) £*1+A 

(Lv) £“'* 1-V 

(v) A V k ^ r yk+r = * r yk + r,2 

(Vi) AVy* = VAy* - S 2 y k 

(vii) ACy*) = 0* +J^t+i)Ay* 

(viii) A<l/y A ) = -AVCVin+l) 

3.11. Show that £=S + A and A 

h V(l-V)" 3 . Also, deduce that 1 +A 



3.12* The population of a town in decennial census were as under. Estimate 

the population for the year 

1955 

Year 

Population 
(in thousands) 

1921 

46 

1931 

66 

1941 

SI 

195! 

93 

1961 

101 

3,13* Find the missing term in the following table: 

X 

y 

0 

I 

t 

3 

2 

9 

3 

7 

4 

81 


Explain why the result differs from 3 3 -27? 
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3,14, The probability integral 



lias fee following values: 


X 

P 

LOO 

0.682689 

LOS 

0,706282 

1,10 

0,728668 

1.15 

0.749856 

L20 

0.769861 

J.25 

0.788700 

Calculate p for x = 1*235. 


3*15. Prove the following relations where the operators have their usual 

meanings 

(i) J 2 £ = A 2 

Gi) 

(iii) ] + S 1 fi 1 =(l+S 1 /2y t 

(iv) pE = Bp 

(v) V^SET yi 

(vi) A - V = <J 2 

(vii) p = cosh (u/2) where 

u = kD 

(viii) /■(!)= ttsm - mw 2 m + a/MVtfVco 

3,16. The values of the elliptic integral 



K(m) = 

J (\-mSM 2 8r vl d6 

£t 

for certain equidistant values of m are given below. Use Everett's 
or Bessel's formula to determine £(0.25). 

m 

K(m) 

0.20 

1.659624 

0,22 

L66985G 

0,24 

1,680373 

0.26 

1.691208 

0*28 

1.702374 

0*30 

1,713889 


3*17* From Bessel's formula, derive the following formula for midway 
interpolation: 
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JVj=5tht+^)~(*i-l + Ajo) + ^( A Vj + A Vl)—■ 


Also, deduce this formula from Everett’s formula, 

3 ,IS. State* without proof Stirling’s formula for central interpolation and 
mention its limitations. 

From the following table of values of x and y - a 1 , interpolate the 
value of^ when je~l*9I 


3 * 19 * 


3 . 20 . 


3 * 21 . 


X 

y*e x 

1*7 

5*4739 

1.8 

6.0496 

1*9 

6.6859 

2.0 

7,3891 

2*1 

8.1662 

2*2 

9.0250 


Use Stirling's formula to find from the following table 

= 14.035, 

1*25 = 13.674, w 30 = 13.257, 

u i$ = 12,734. 

u m -12.089, i* 4 5=n.309. 

From the following table. 

find y when x * 1,45. 

X 

y 

1.0 

0,0 

1.2 

-0.112 

1.4 

-0.016 

1*6 

0.336 

1.8 

0.992 

2*0 

2,0 

The following values of j 

: and y are given. Find y (0.543); 


X 

yix) 

0.1 

2.631 

0.2 

3.328 

QJ 

4.097 

0,4 

4.944 

0,5 

5,875 

0.6 

6,896 

0.7 

8.013 
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3,22* Using Gauss's forward formula* find the value of/{32) given that 
/(25) = 0.2707, /(30) = 0,3027, 

/(35) ■>= 0.3386, /(40) = 0J794, 

3*23* Using Gauss's backward formula, find the value of J12516 given that 
,/TBOO = 111.803399, ^12510 =111.84811], 

./I2S20 =111.892806, /12530 = 111.937483 

3.24 Evaluate sin (0.197) from the following table: 


X 

sin x 

0,15 

0.14944 

0.17 

0,16918 

0,19 

0.18886 

0*21 

0.20846 

0,23 

0,22798 


3*25* Using Everett's formula, evaluate f{2$) from the following table: 

* m 

20 2854.0 

24 3162.0 

28 3544,0 

32 3992.0 

3*26* Given the table of values: 

* _ 

150 12,24? 

152 12.329 

154 12.410 

156 _ 12.490 

evaluate /BS using Lagrange's interpolation formula. 

3,27* Show that 


I 

4 = I 


xjt) 
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3.28, If i(f) is analytic inside the closed contour C and If t t t x j 2 ^^t n 
lie inside C, show that the remainder term in the error formula for 
polynomial interpolation can be written as 

*£> f . - dr. 

2m J (r-/}*(*) 

3.29, Show that J] " a0 ^{x) = 1 for all x» 

3.30, Applying Lagrange ’s formula, find a cubic polynomial which approximates 
the following data' 

* y(s) 

-2 -12 

-1 -8 

2 3 

_3_ 5 

3.31, Using Lagrange's formula, express the rational function 

3x* + x-hl 
Cr-l)(jc-2)(x~3) 

as a sum of partial fractions. 

[Hint: Let /(*) = 3x*+x +L Form a table of values of /(*) for 
jr*l,2»3. Obtain the second-order Lagrange polynomial £ 2 (x)| 
[Stanton] 

3.32, Express the function {jr*x-3)/0r -2 jt-x + 2 ) as a sum of partial 
fractions, 

3.33, Given the data points (1* ™3) t (3 + 9), (4 S 30) and (6, 132) satisfying 
the function y=/(x)» compute /(5) using Lagrange polynomials 
of orders 1 to 3. 

3.34, Establish Newton's divided-difference formula and give an estimate 
of the remainder term in terms of the appropriate derivative. 

Deduce Newton’s forward and backward interpolation formulae as 
particular cases, 

3-35- If f(x)- l/x 2 f find the divided-differences [a, jfr] and [a r b , c], 

3,36, Given the set of tabulated points (1, -3), (3, 9), (4 t 30) and (6,132), 
obtain the value of y when x = 2 using: 

(a) Newton's divided-difference formulae of orders 1 to 3, and 

(b) Aitken's method. 

3.3 7. Show that the nth divided-difference [x^, Xj.,,,., x H ] can be expressed 
as the quotient of two determinants, shown as follows; 
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1 I I - I 


*0 


*2 

" 

x « 

x l 

x i 

x \ 

** 

x 2 


*r 

*T* 

** 

X * 1 


y\ 


•* 

y* 

1 

i 

1 

1 



*i 


x n 


x 2 

*0 

x 2 

X 1 

Jl 

x 2 

x 2 

x h 


X Q 

x l 

x 2 

*: 



3.38. If the abscissae x^/ = Q, are distinct and if y = f{x) is h 

times continuously differentiable „ show that 

= J ••• J /"Htox,, +([* +•■ 

where f 0 £ Q and Ej% 0 t f -1 . 

3.39. Tabulate the function y -sin x for x-0 to 1.0 in steps of h - 0.01. 
Find the error of linear interpolation in this table. 

3.40. Find the error of quadratic interpolation in the above example. 

3.41. Prove that the third divided difference of the function f(x) = Mx with 
arguments p^q,r t s is -1 f{pqrs). 

3.42. If / (x) - 1/jc, (wove that 




» — 


Hf 

* 0 X\-. x r' 


3.43. Given the table of values 


X 

IT* 

50 

3.684 

52 

3,732 

54 

3,779 

56 

3,825 


Use Lagrange's formula to find x when = 3.756. 
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3.44. From the table of values 


X 

y 

U 

2.9422 

2.0 

3.6269 

2.2 

4.4571 

2.4 

5.4662 

2,6 

6,6947 

find x when y - 5.0 using the method of successive approximations* 
From the following table of values, find jt for which sinh x-5: 

X 

sinhx 

2.2 

4,457 

2.4 

5.466 

2.6 

6,695 

2.8 

8.198 

3,0 

10*018 

Develop a subprogram, in FORTRAN or C, to implement Lagrange 
interpolation and test it on the data of Problem 24. Compare it with 
the result obtained by using the MATLAB 'polyfit function' to fit 


a fifth-order polynomial 

3.47. Reciprocal differences: The concept of reciprocal differences will 
be useful in determining a continued fraction approximation which 
agrees with a tabulated fraction/fr) at the set of points ^ p x i ,., x n . 
We define quantities 

called the reciprocal differences in the following way: 




_ *-*o 

AM" AM /(*)-/(JT d) 


AM *1**21 = 




and so on. Then following the procedure outlined in the derivation 
of Newton's divided-difference formula, we derive the general formula 

Aw=/(v+ rtt ^ ] + A[ ^^ ] +^"^ 

which is the required continued fraction approximation to the given 
set of tabulated values. 
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Use the above method to obtain a continued fraction approximation 
to the set of points (U I) (2* 4) 1 ,{3 1 9) and (4, 16). 

Apply reciprocal differences to 
from the following data: 

recover the function f{x) = 1/(1 + x 2 ) 

X 

/(*) 

0 

1 

1 

1/2 

2 

1/5 

3 

1/10 

4 

1/17 

5 

1/26 

Using Hentiiie-s interpolation formuJa s estimate the value of In 3.2 
from the following table: 

x y-Inx 

y=i/x 

3.0 L09S61 

0.33333 

3-5 U5276 

0*28571 

4.0 1.38629 

0.25000 


3.50, Find the Heimite polynomial of the third degree approximating the 
function y(x) such that >(x 0 } = 1, _y^X|) = 0 and /(xq)= y'(xj) ■ 0, 
3*51* Show that the error in Hermits formula is given by 

where y(jc) is assumed to have continuous derivatives of order 
(2n + 2) and £=£(x) is in the interval determined by the points 

3.52, The function y-x 3 +9 is tabulated below: 

* y 

1 36 

4 73 

5 134 

Predict the value ofy(4.5) by using quadratic and cubic splines and 
state the absolute error in each case. 

3*53* Fit a cubic spline to the function defined by the set of points given 
in the table: 
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X 

y = e J 

0.10 

1.1052 

0.15 

1.1618 

0.20 

1.2214 

0.25 

1.2840 

0.30 

1.3499 


Use the end conditions: 

CO - 0 

(ii) f f (0.10)«j/(0.10) and *'(030) = /(0JO). 

(iii) s"(0A 0) = y"{0 JO) and s"(0.30) = y"{0 30). 

Interpolate in each case for x^ 0,12 and state which of the end 
conditions gives the best fit. 

3.54. Deduce the expression for the error in the spline second derivative: 

3.55. Determine the cubic spline s[x) valid in the interval for 

the following data, given that and }*/*{*„); 


(a) x 

y = x In jc 

(b) 

X 

y = tan x 

6.2 

11.3119 


1,3 

3.6021 

6.4 

11.8803 


1.4 

5.7979 

6.6 

12.4549 


hS 

14,1014 


3.56. In the interval [£j* %j]* the cubic spline ^(x) may be expressed as 

s f {x) = a t + fyO t- %} + Cj(x-Xf) 2 +df(x-x t f t / = 0, 1. n-l 

Determine the constants a (1 b ft c f and d h using the conditions for 
a natural cubic spline. 

3.57. Develop a subprogram to implement the natural cubic spline 
interpolation and test your program on the data of Problem 53. Also, 
use MATLAB spline function on the same data and compare the 
results. 

3.58. The following table gives the values of t - /( x f y) for different values 
of jr and y. Use the methed of Section 3.12 to find z when jc - 2.5 
and y -1.5, Compare your result with the actual value obtained 
from f(x,y) = x+y 1 + y- 
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r 

y 12 3 

1 3 6 11 

2 7 10 15 

3 13 16 21 

3.59, Repeal problem 58 using cardinal splines, 

3.60, Develop a subprogram to evaluate the cardinal splines L t (x) and the 
general cubic spline s(x, y). Test your subprogram on the data of 
problem 58. 
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CHAPTER 

■ 


Least Squares, B-splines and 
Fourier Transforms 

wmmmmmtm ——— 11 ————J 


4.1 INTRODUCTION 


In experimental work, wo often encounter the problem of fitting a curve to 
data which are subject to errors. This is contrary to the case considered in 
the preceding chapter where we assumed that the data are free of errors. 
A common strategy for such cases is to derive an approximating function 
that broadly fits the general trend of the data without necessarily passing 
through the individual paints. The curve drawn is such that the discrepancy 
between the data points and the curve is least. The method of least squares 
is most commonly applied in such cases and is described in the earlier 
sections of this chapter. 

Data fiting by means of polynomials has been considered, in the previous 
chapter, from the viewpoint of cubic splines. The resulting approximation, 
called the cubic spline approximation, suffers from the disadvantage of 
being a global approximation, which means that a change in one point 
affects the entire approximating curve. We describe, in the present chapter, 
a method based on basis splines, called B-splines, which possess a local 
character, viz., a change in one point introduces a change only in the 
immediate neighbourhood of that point. The R-sptine method finds important 
applications in computer graphics and smoothing of data. The ‘B-spline and 
its computation* will be discussed in Section 4.5. 

In the previous chapter, we concentrated on polynomial interpolation, i.e, 
interpolation based on a linear combination of the functions I, x, jr 2 , ..., sr". 
On the other hand, trigonometric interpolation, i.e. interpolation based on 
trigonometric functions 1. cos x, cos 2x,,,,, cos nx, sin x, sin 2x, ♦.., sin nr, plays 

13? 
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an important role in modelling oscillating or vibrating, systems. The Fourier 
series is a useful tool for dealing with periodic systems but for aperiodic 
waveforms, the Fourier integral or the Fourier transform is the primary tool 
available. Numerical methods for the computation of discrete ‘Fourier 
transforms’ are discussed in Section 4.6. 

We shall finally consider, in the concluding section, the representation 
of functions by Chebyshev polynomials as also the economization of power 
series. These are important from the standpoint of digital computation . 

C2 LEAST-SQUARES CURVE FITTING PROCEDURES 

Usually a mathematical equation is fitted to experimental data by plotting the 
data on a graph paper and then passing a straight line through the data 
points. The method has the obvious drawback in that the straight line drawn 
may not be unique. The method of least squares is probably the most 
systematic procedure to fit a unique curve through given data points and is 
widely used in practical computations. It can also be easily implemented on 
a digital computer. 

Let the set of data points be (Jf /f = 1,2,and let the curve 
given by F = /(i) be fitted to this data. At x = ^ t the experimental (or 
observed) value of the ordinate is y t and the corresponding value on die 
fitting curve is If Is the error of approximation at a = x t , then we 

have 


If we write 


*i = y t ~f{x,y 


<4J) 


=«*+*! + —+ ej. (4.2) 

then the method of least squares consists in minimizing S, i.e. the sum of 
the squares of the errors. In the following sections, we shall study the linear 
and nonlinear least squares fitting to given data m. 

4,2.1 Fitting a Straight Line 

Let F = £^3 + fjjjr be the straight line to be fitted to the given data. Then, 
corresponding to Eq.(4.2) we have 

£ - [>i +a l Jc l)] 2 + [> J 2 “(^0 + ' + _ (^0 +a ri c jnrf- (43) 

For S to be minimum, we have 
clS 

— =ti^-2[y i ~(a Q + G l x ] )]-2[y 2 -(a {i +a l x 2 )}---2[y tri -(-a i:} + a i x m )] 

(4.4a) 
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and 


— = 0 = -2xjOj + -faj +<* 1 * 2 )] 

dot 

— - 2x m [y m -(oq + o^)]. (4,4b) 


The above equations simplify to 

ma 0 + o 1 ( jt i +x 2 +—+x m }=yi +yi++y m (4 5a ) 

and 

^+^+-’+^ f )+flt(jc I 2 +JEj+-+xi)-^+^+-+x -r ^ ( 4 . 5 b) 


or* more compactly to 


and 


m m 

mc^+a 1 ^ ^ 


( 4 , 6 a) 


°o +Z *» +o >Z *? ■ Z (4 - 6bJ 

J*| /«! J>| 

Since the x, and y t are known quantities, Eqs. (4.5) or (4,6)* called the 
normal equations * can be solved for the two unknown a 0 and ft]. 

Differentiating Eqs. (4,4a) and (4.4b) with respect to oq to respectively, 
we find that d 2 Sfda$ and trSfdaf will both be positive at the points a Q 
and 0 |, Hence these values provide a minimum of S. 

Further, dividing Eqs. (4.6a) throughout by m, we obtain 

oq +a l x = y, 

where (I, y) is the centroid of the given data points.lt follows that the 
fitted straight line passes through the centroid of the data points. The 
following example demonstrates the working of this method. 

Example 4.1 The table below gives the temperatures T (in *C) and lengths I 
(in mm) of a heated rod. If l-a^ +#\T y find the best values for oq and a v 


T (in °C) 

/ (in mm) 

20 

800.3 

30 

800.4 

40 

800.6 

50 

800,7 

60 

800.9 

70 

801.0 
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To me formulae (4.6), we requite ZT, ZJ, ZT 1 and £77, and these are 
computed as in the following table: 

r(In*C) /(in mm) T 2 Ti 


20 

800.3 

400 

16006 

30 

800-4 

900 

24012 

40 

eoo.e 

1600 

32024 

50 

8007 

2500 1 

4003 © 

60 

800:9 

3600 

46054 

70 

801.0 

4100 ' 

56070 

270 

4603.9 

13900 

216201 


Using formulae (4.6) we then obtain 

6 % + 270a, = 4803 S and 270ofc + 13900^ =216201, 

from which we get oq-800 and ^ = 0.0146. 

Example 4*2 Certain experimental values of x and y are given below 


*_ y 


0 

-1 

2 

5 

5 

12 

7 

20 


]f y - oq + U|je t find approximate values of % and a x . As in the previous 
example, we form the following table of values: 


X 

y 

£ 

x ¥ 

0 

-1 

0 

0 

2 

6 

4 

10 

6 

12 

2£ 

60 

7 

20 

49 

140 

14 

36 

78 

210 


Formulae (4.6) give the two equation! 

4oq + 14a, +36 and 14q, + 78^ = 210. 

Solving the above two equations, we obtain ^ = -U381 and a, =2.8966, 
Using these values we obtain y(S)» 13.3449, 

It may be noted that the given table is obtained from the relation 
y = -1.0334 + 2.6222* so that the correct value ofX5) is 12.0776. 

4 * 2*2 Nonlinear Curve Fitting 

In this section, we consider a power function, a polynomial of the nth 
degree and an exponential function to fit the given data points 
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Power function Let y - ax^ be tile function to be fitted to the given data. 
Taking logarithms of both sides, we obtain die relation 

Jog y = k>g a + c Hog. x, (4.7) 

which is of the form Y - + aj X , where Y = 1og >f, a$ = log a. aj = c and 
X - log x Hence the procedure outlined in the previous Section can be 
followed to evaluate a Q and Then a and c can be calculated from the 
formulae = jog q and c = a,. 

Polynomial of the nth degree Let the polynomial of the nth degree, viz., 
Y = flfo+fljX + 02J 3 (4.8) 

be fitted to the data points (jq,y,},i = l,2 I *.. l m, We then have 
s = [« -(ao +o,i| +■ +a„*")] 2 +[^ -(<n, to,*j t - +o„*J)]* 

+■"+[)*.-(^ + ^* B +-+V r S)f- (4.9) 

Equating, as before, the first partial derivatives to zero and simplifying, we 
get the following normal equations 


hi in n in 

inao + o,^ tj+02X *? + "‘ + 4«2 *"=£ Ji 

/=! (=1 f-l i-J 

i - 1 iml !■! !■! 


(4.10) 


x ? +(J l£ x " + ' + 
i-i r-i 




These are (it + J) equations in (n +)) unknowns and hence can be solved for 
, r ,, p Oj ,, Equation (4.8) fen gives the required polynomial of the mh degree. 
It should be noted that for large values of n, the normal equations given 
by (4.10) are unstable (or ill-cotKlitioned) with the result that roundoff errors 
in the data may cause large changes in the solution. Such systems occur, 
quite often, in practice and we shall study their nature in a later chapter. It 
is sufficient to remark here that orthogonal polynomials are most suited to 
solve such systems and one particular form of these polynomials, the 
Chebyshev polynomials, will be discussed later in this chapter. 

Example 43 Fit a polynomial of the second degree to the data points given 
in the following table 


X 

y 

0.0 

l.o 

1.0 

6.0 

2.0 

17.0 
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In Eq. 

(4*10), we 

require the * 

quantities Zx h Zxf,ZxJ, 

Ir* 

, Ek. Zjc^y, and 

Zxfyi. 

These are 

computed as 

i in the following table: 



X 

Y 

jr* 


** 

xy 

**y 

0 

1 

0 

0 

D 

0 

0 

1 

6 

1 

1 

1 

6 

e 

2 

17 

4 

e 

16 

34 

66 

a 

24 

S 

& 

17 

40 

74 

Using : 

Eqs. (4.10), 

we now obtain the equations 




3oq + 3^ +■ 5 a 2 = 24 
3oq + SO| + 9ti 2 = 40 
5oq Hr9£3| +1 la 2 = 74. 

the solution to which is < 2 q = 1 , a l = 2 and £ 2 2 “ 3 - 

The required polynomial is then given by Y = 1 + 2x + 3jr 2 . From the 
given data points, it Is seen that this polynomial fitting is *exact ! . 

Exponential function Let the curve 

y = a 0 e° ,t (4.11) 

be fitted to the given data. Then, as before, taking logarithms of both sides 
of (4.11), we get 

tog y^log^+dt*. (4J2) 

which can be written in the form 

Z^A + Bx» 

where Z * log y t A-hga^ and 1? = ^, The problem therefore reduces to 
finding a least-squares straight line through the given data. 

Example 4*4 Determine the constants a and b by the method of least 
squares such that y - ae bx fits the following data 


X 

y 

2 

4.077 

4 

11.084 

6 

30.128 

8 

81.897 

10 

222.62 


The given relation is y - ae 1 ™. Taking logarithms of both sides, we obtain 

bty = In&+fe*. 

Setting In y = Y t jc = X 9 in a - % and b-a^, the above relation takes 
the form y = ao + a Y x, which is a straight line. 
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The method of procedure is the same as in Section 4.2.1 and we form 


the following table: 

Y^itxy 

X a 

XY 

2 

1.406 

4 

2.610 

4 

2.405 

16 

9-620 

fl 

3,405 

36 

20,430 

B 

4406 

m 

36,240 

10 

5,406 

100 

§ 4,050 

30 

17.025 

220 

122,150 


Formulae (4-6) give 

$00 + 30^ = 17.025, 30^ + 220a, =122.150, 

which yield the solution: 


Hence 


oq =0.405 and = 0.5. 

<j = = e 0M5 = 1.499 and b = a, =0,5, 


4.2.3 Curve Fitting by a Sum of Exponentials 

A frequently encountered problem in engineering and physics Is that of 
fitting a sum of exponentials of the form 

y = f(x) - + - + V V (4,13) 

to a set of data points, say (x 1+ ^) l (x 2+ >' 1 ) 1 ... t (.t rt ,y rt ). 

In (4,13), we assume that n is known and A X ,A 2 .4,,^,%..,,^ 

are to be determined, It can be seen that/(*) satisfies a differential equation 
of the type 


d H y d^y 
dx n + “ l dx*-' 


+ Qj 


d H ~ 2 y 

dx"~ 2 


+ 


■ + a n y = Q, 


(4.L4) 


where the coefficients are presently unknown. 

A method suggested by Froberg consists in numerically evaluating the 
derivatives d n yldx n 3 d n ~ l yldxf~ 1 ,,., at the n data points and substituting them 
in (4.14), thus obtaining a system of ft linear equations for the n unknowns 
a Xi a 2 which can then be solved* Again, it can be verified that 
A l ,A 2 ,,.. 1 i B are the roots of the algebraic equation 

A n + 0|2" -1 +tf 2 A"" 2 + L, +iJ n =0i» (4. IS) 

which when solved enables us to compute A h A 2 . A* from (4,13) by 

the method of least squares. An obvious disadvantage of the method is the 
numerical evaluation of the derivatives whose accuracy deteriorates with 
their increasing order and leading, therefore, to unreliable results. 
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We describe now a computational technique, due to Moore (1974], 
which leads to more reliable results. We demonstrate the method for the 
case n = 2. 

Let the function to be fitted to a given data be of the form 

y^Ate^ + ^e* 2 *, ( 4 , 16 } 

which satisfies a differential equation of the form 


ii 

A 2 


dy 

= 0,^+0^ 


( 4 . 17 ) 


where the constants tt t and a; have to be determined. Assuming that V is 
the initial value of x, we obtain, by integrating (4J7) from *a* to s t the 
following equation 

* 

y'(x)-yXa ) = a,jKx>-£i|><£i) + a 2 J y(x) dx, (4.18) 

a 

where y\x) denotes dytdx. 

Integrating (4.18) again from a to x, we obtain 


X XX 

y(x)-y(a)-yXaXx-a)zxa 3 J + J j y{x)dxdx„ 

a a a 


Using the formula 


(4.19) 


}... j l — j (x-,r'mdt (4.20) 

'£10 a 

Eq + (4.19) simplifies to 

X X 

y(r}-y(a)"(r-o)/(o) s % j -a)y(a) + a a J (x -0MO dt. 

a & 

(4,21} 

In order to use Eq. (4,21) to set op a linear system for &\ and yX&) 
should be eliminated and this is done in the following way. Choosing two 
data points *i and such that a - 1 , = x 2 ~ a * we obtain from (4,21} 

M*i)-y(fl)-(JCi -tfJyW-fli }M*><&“<%(*! “*)K<O+02 j (**“0MO dt 

a a 

y(x 2 )-y(a}~(x 1 -a)/{a)=a l | yixjdx-a^xh -a) y(a)+a 2 j ( Xl -t)y(t)dl> 
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| y(j)ctc + | 

Q 0 


+ *2 




(x 2 -t)y{t)di 


■ (4-22) 


Equation (4.22) can now be used to set up a linear system of equations for 
d] and aj, and then we obtain A { and a 2 from the characteristic equation 

X 2 = + a 2 , (4.23) 

Finally, A, and A 2 can be obtained by the method of least squares. The 
method of procedure is illustrated by the following example. 


Example 4.S Fit a function of the form 


to the data given by 

x 

Id) 

U 

1.2 

1.3 

1.4 


y-A^ x 

y 

X 

y 

1.54 

1.5 

2.35 

1,67 

1.6 

2.58 

] .81 

1.7 

2.83 

1,97 

IJ 

3.11 

2.15 




(i) 


Choosing jq =1,0, a = L2 and jr 2 -1.4, Eq. (4.22) gives 


0.07 = a, 


iJ t.4 

- J y(x)dx+ j y(x)dx 

10 12 


+ &2 


IJ 3.4 

- | (LO-f)K0* + J (14 


L 1.0 12 J 

Evaluating the integrals by Simpson’s rule and simplifying, the above equation 
becomes 


1.81o l +2J>0tf2 -2.10. (it) 

Again, choosing jq = IA, a “1.6 and x 2 -1.8, and evaluating the integrals 
in (4.22), as before, we obtain the equation 

2.&3d 1 +3.104^ =3.00. W 
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Solving (ii) and (iii), we obtain =0.03204 and a 2 - 0,9364. Equation (4.23) 
now gives 

* 2 - 0.032042-0.9364-0, 

from wbicb we obtain 

Aj = 0.988 = 0.99 and 4 = -0.96. 

Using the method of least squares, we obtain 

4 - 0,499 and ^=0,491. 

The above data was actually constructed from the function y = cosh x so 
that 4 = A 2 - 1 / 2 , 4 = 1,0 and ^ = -L 0 , 


4.3 WEIGHTED LEAST SQUARES APPROXIMATION 

In the previous section, we have minimized the sum of squares of the 
errors. A more general approach is to minimize the weighted sum of the 
squares of the errors taken over all data points* If this sum is denoted by 
S, then instead of Eq. (4*2), we have 

«“»![»-/(*| )f + »i £»-+- + W m \y M - f(*m )] 2 

+»> 2 . (4.24) 

In {4.24), the W t are prescribed positive numbers and are called weights, A 
weight is prescribed according to the relative accuracy of a data point. If 
all the dam points are accurate, we set W t - 1 for all L We consider again 
the linear and nonlinear cases below* 

4,3.1 Linear Weighted Least Squares Approximation 

Let 7 = ^ + ^! be die straight line to be fitted to the given data points, 
viz- ...,{x Mt y m ). Then 




t =I 


For maxima or minima, we have 


as 


as 


= 0 * 


which give 




(4.2S) 


(4.26) 


(4.27) 
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and 


£-*£ w, \y, -to =0. (4.28) 

& i 7~\ 

Simplification yields the system of equations for o$ and £j ( : 

«%£ V + a, £ W,x, ^W,y, (4.29) 

J-l l*\ ( = 1 

and 

<%£ w * + ■°i S w <*f =z tw- ( 4 - j °) 

i ■I ril i — E 

which are the normal equations in this case and are solved to obtain % and 
Ug. We consider Example 4.2 again to illustrate the use of weights. 

Example 4,6 Suppose that in the data of Example 4.2, the point (5, 12) 
is known to be more reliable than the others. Then we prescribe a weight 
(say, 10) corresponding to this point only and all other weights are taken 
as unity. The following table is then obtained. 


X 

y 

W 

m 

Wx z 


Wxy 

0 


1 

0 

0 

-i 

0 

2 

s 

1 

2 

4 

5 

10 

5 

12 

10 

SO 

250 

120 

600 

7 

20 

1 

7 

49 

20 

140 

14 

36 

13 

SO 

303 

144 

TWO 


The normal Eqs. (4.29) and (4.30) then give 

[30$ +59^ -144 (i) 

59^ + 303^=750, (ii) 

Solution to eqs. (i) and (ii) gives 

% - -1.349345 and = 2,73799. 

The linear least squares approximation" is therefore given by 
y = -t349345 + 2,73799*. 

We obtain 

y (5.0)«12.34061 = 12.34061, 

which is a better approximation than that obtained in Example 4.2. 
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Example 4,7 We consider Example 4.6 again "with an increased weight, say 
100, corresponding to y(5U) + The following table is then obtained. 


X 

y 

W 

Wx 

Wk 2 


Wxy 

O 

-1 

t 

O 

0 

-1 

0 

2 

5 

1 

2 

4 

5 

10 

6 

12 

100 

600 

2600: 

1200 

6000 

7 

£0 

1 

1 

49 

20 

140 

14 

36 

103 

509 

2553 

1224 

8150 


The normal equations in this case are 

itOoa+SO^ “1224 (i) 

and 

509^+2553^ =0150, 00 

Solving the above equations, we obtain 

^ =-1.41258 and o, = 2,69056. 

The required ‘linear least squares approximation 1 is therefore given by 
y=- -h 41258 + 2,69056*, 
and the value of y(5)-12,0402. 

It follows that the approximation becomes better when the weight is 
increased. 


4.3.2 Nonlinear Weighted Least Squares Approximation 

We now consider the least squares approximation of a set of m data points 
J = 1,2* by a polynomial of de^ee n <m. Let 

y = a Q +a l x + a 2 x 2 + ■■■ + a Jl x Jt (431) 

be fitted to the given data points. We then have 


S(^Oy .= X ^ “ (‘V* ^ + ' + a H x i)f- (432) 

/-] 

If a minimum occurs at (%^Oj 1+ .^o )i ), then we have 

.0. (4.33) 

day % da„ 
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These conditions yield the norma! equations 

w < + °iE w * +’-**.£ w *i=X w <>> 


iml 


J>1 


M 


t-j 


w i x i*°iX w t c f+-+ a nX w > x ^' "X w t*tn 


M 


t=] 


ifel 


(4.34) 


^X w < x r +a tX •rt**-”++L w ‘ x ?=X w ‘ x ?y<- 

i = ] i = 1 M ( = 1 

Equations (4 34} are (#j + l) equations in (« + !) unknowns Oq, a,, a M . Jf 
the Xf are distinct with rt<ttt, then the equations possess a ‘unique* solution. 

4.4 METHOD OF LEAST SQUARES FOR CONTINUOUS FUNCTIONS 

In the previous sections, we considered the least squares approximations of 
discrete data. We shall in the present section, discuss the least squares 
approximation of a continuous function on [a, 6), The summations in the 
normal equations are now replaced by definite integrals. Let 

y{x) = a Q +a i x + a 2 x 1 + * + a H x n (4,35) 

be chosen to minimize 

b 

= j , ff r (r)[y(x)-(flj + fl,* + " +o w i fl )] z rfr. (4.36) 


The necessary conditions for a minimum are given by 


aj = as _ a s 0 

fob &I| 3n n ’ 


(4.37) 


which yield 


-2 J fF(x}bC>)-(* +<K*+<V? + ■ + < V c")|A = 0 

a 

b 

-2 | W(x) [y(x) - (ojj + + oji 3 +■*« + <?„*"}} .r dx = 0 

a 

b 

-2 |JT(x)[**)-(<H> + <f|* + oi* 3 + + =„*")]Jr 5 dx = 0 

a 
b 

-2 j IV(x) [y(x) - (cfo + djx + Ojx 2 + — + a„x n )] x n dx = 0. 


(4,38) 
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Rearrangement of terms in (4.38) gives the system 

b b b b 

% j W(x)dx^a l | xW(x)dx+- + j x n W(x)dx = J JF(x}y<jf)d!x 

a a a a 

b b b b 

Oq jxW(x)dx+o l jx 2 W(x)dx+ -+a n \x* +x W{x)dx^ jx lV{x)y(x)dx 

a O a a 


b b b b 

Jj^fFC^+a, jx n+x W(x)dx+—+a m jx*W(x)y{x)dx. 

A A A A 

(4.39) 

The system in (4 J9) comprises (n +1) normal equations in (n +1) unknowns* 
viz. ceq,si + oj,.... a n and they always possess a 'unique’ solution. 

Example 4*8 Construct a least squares quadratic approximation to the 
function yfx) = sm x on [0,. #12\ with respect to the weight function IF(x) = l. 

Let 

F = ^ +a iX + a 2 x 2 (i) 

be the required quadratic approximation. Then using (4.39), we obtain the 
system 


nfl xfZ stl Ktl 

% J dx-¥a t J x dx + oi | x 2 dx — | sin x dx 
so oo 

*fl nil xfl xt2 

oq | jciir + Oi | x 2 dx + J - J x sin x <ir 
0 0 0 0 

*n rii xii idi 


% J Jt 2 + £1| Jx 3 £hf + % j X 4 dx - J X 2 sin x dx. 


Simplifying (ii), we obtain 


X It It . 

Oft —+ fli-+ Qy -- 

0 2 1 8 2 24 

-2 ,3 

jr Jt . 

JT 5 JT 4 JT 5 JT \ 

24 + ° l 64 + ° 2 160 ~ (2 J’ 


m 
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whose solution is 


IS % m 

^ = 7 + ?“ 


01- 


144 

jl ' 


02 =- 


JT' 

240 2830 


1344 5760 

l + jr4 
ft M 


11520 


{iii) 


The required quadratic approximation to r v = sinx on [0,jrf2] is then given 
by (i) and (iii), 

As a check, we obtain, at t = jr/4, 

sin * * ^= 0.706167587, 

if IT 1 IT 3 

The true value of sin (ff/4) ■ 0.70710678 l t so that the error in the above 
solution is 0.000939194, 


4.4.1 Orthogonal Polynomials 

In the previous section* we have seen that the method of determining a least 
square approximation to a continuous function gives satisfactory results. 
However* this method possesses the disadvantage of solving a large linear 
system of equations. Besides, such a system may exhibit a peculiar tendency 
called ill-conditioning, which means that small change in any of its parameters 
introduces large errors in the solution—the degree of ill-conditioning increasing 
with the order of the system. Hence, alternative methods of solving the 
aforesaid least-squares problem have gained importance, and of these the 
method that employs Orthogonal polynomials" is currently in use. This method 
possessess the great advantage that it does not require a linear system to 
be solved and is described below. 

We choose the approximation in the form: 

Y(x) = flo/tiC*) + a\A (*) + ■ + H-40) 

where fj(x) is a polynomial in x of degree j. Then, we write 
b 

S(.a a ,a y .o„)= J »'WW*)-[<%/c(*)+<%/iW+-+o„/.U)H i abt.(4.4]) 

a 

For S to be minimum, we must have 


/riqht 


Presented By: http://www.ebooksuit.com 




152 Chapter 4: Least Squares, B-splines and Fourier Transforms 


^-=0.-2 f W(x) lK Jt )-[ fl o/c(*) +il l/if J[ ) + -■ +a ir/ii<*)]>A(*)<* 


dS 


^ =0=-2 J (*)+• ■ 


as 




(4.42) 


The normal equations ate now given by 

b b b 

Off a 

b 

» | y(x) ><*)/„(*) * 

a 

« * fr 

J ^W/iWAWA+ei f W(x)rf(x)dx+-+a n J 

a o d 

b 

- J rw^/iW* 

a 


£ fr A 

«o J»W,00/oM‘*+*i J»'WAWyiW<i*+- +o,Jffwrfltkfc 

a cf a 

b 

= J r(x)K*)/„ti)<fe. 

a 

(4,43) 

The above system can be written more simply as 


b & 

a# J W(x)Mx)f J (x)dx* ai | W{x)f i {x)f J (x)dx+-- 

a a 

b b 

+ S | ^C*)/*(*)/j(*}^ - | W(x)yix)fj{x)dx 3 
a 0 


J = 0, I, 2. ,n, 

(4,44) 
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In (4.43), we find products of the type / p (i)^(.r) in the integrands, and 
if we assume that 


f 


W{x)f p (x}f q (*)<t*= 


a 


o, 


h 


I W(x)fp(x)dx t 


a 


P = 9f 


then the system (4.43) reduces to 

b b 

Ob j - I W{x)yi?} Mx)dx 

a a 


(4,45) 


b 6 

a n | W(x)f*(x)dx= J ^{j)^(x)/ n (j)dt, 

a a 

From the above, we obtain 

b 

j roort*)/,(*)* 

aj=— b -, J-o, 1.2 .»■ < 44 *) 

| W(x)fJ{x)dx 

0 

Substitution of in (4.40) then yields the required least squares 

approximation, but the functions /&(*)>/*(*)*,,*»/*{*) are still not known. 
The fj {*% which are polynomials in jc satisfying the conditions (4.45), are 
called orthogonal polynomials and are said to be orthogonal with respect to 
the weight function EF(*). They play an important role in numerical analysis 
and a few of them are listed below in Table 4.L 


Table 4.1 Orthogonal Polynomials* 


ton® 

m 

SniervaS 

W[x) 

Jacobi 


H. 1] 

(i- *ni+ x/{b. / >-i) 

Chebyshev 
(first kind) 

W) 

M i! 

(l-JT 2 )- 1 ' 2 

Chefayshev 
(second kmd) 

Uni*) 

l-i, i] 

(I-**)’* 

Legendre 

WO 

i-X 1) 

1 

LaguBne 


la®) 

S'* 

NerfTMie 

M n (x) 

H *4 



♦For more details concerning orthogonal polynomials, sec Abramovitz and £ regun 
[1W5]. 
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A brief discussion of some i mportant properties of the Chebyshev polynomials 
TJ,x) and their usefulness in the approximation of functions will be given 
in a later section of this chapter. We now return to our discussion of the 
problem of determining the least squares approximation. As w? noted earlier, 
the functions jffjc) are yet to be determined. These are obtained by using 
the ‘Gram-Schmidt orthogonal ization process/ which has important applications 
in numerical analysis. This process is described in the next section. 


4.4.2 Gram-Schmidt Orthogonal ization Process 

Suppose that the orthogonal polynomial valid on the interval [a, &], has 
file leading term jd Then, starting with 

/*(*) = 1 <4.47) 

we find that the linear polynomial/,(*), with leading term x t can be written as 

= * + *| o /ote), (4.48) 

where ij j is a constant to be determined Since/](j) and^(jt) are orthogonal, 
we have 

b b b 

J «Wo(*yiW* = 0= j *»'M/o(*)* + *i,o J W{x)ffa)dx 

a as 

using (4.45) and (4.4 S). From the above, we obtain 

b 

J *W(x)/ i(x)<fe 

A.d=“T- l “- 49} 

J W(x)f*(x)dx 

a 

and Eq. (4.48) gives 

b 

\xW(x)fy{x)dx 

/,{*)= *-y-. 

| W(x)f£(x)dx 

a 

Mow, the polynomial f&x), of degree 2 in x and with leading term x 2 , may 
be written as 


f 2 (x) = x 2 + %/qCx) + k 2 j/it*), (4.50) 

where the consents k 2fi and are to be determined by using the orthogonality 
conditions in (4.45). Since /j(jc) is orthogonal to frfix), we have 
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j W(x)Mx)tf + %/o(j() + * 3 j/, (*)](& = 0. 

d 

Since J* ^(r)/ 0 (i) the above equation gives 

b b 

| x*W{x)fa{x)dx J x Z fV(x)dx 


j W(x)f*{x)dx J Wix)dx 

a a 


(4.51) 


Again, since /^(x) is orthogonal to fi(x), we have 
ft 

I fV(x)f, WE * 2 +*j i 9 / 0 (i)+* 2J /,(*}) * = o. 

or 

Using the condition that J* fl ir (jc) j ^(jr)^j(jc)£fr = O t the above yields 

b 

J 

* 2 .,= "7 -• < 4 - 52 > 

I w/wi 

d 

Since fr 2 ,0 and Jt, ( are known, Eq, (4,50) determines / 2 (x). Proceeding in 
this way’ the method can be general teed and we write 

fj(x) = x J + * 2 ,o/oW +t j,i/iW + —+ (4-S3) 

where the constants kjj are so chosen that is orthogonal to 
/o(x) f /i(*)i -m These conditions yield 

b 

J x>W(x)f,{x)dx 

k ‘ -, (4.54) 

#S ■ fr 

[ W(x)ffa)dx 

Q 

Since the a, and f£x) in (4.40) are known, the approximation Ffr) can now 
be determined. The following example illustrates the method of procedure. 

Example 4 f # Obtain the first-four orthogonal polynomials on [-L 1] 

with respect to the weight function FF(x) = I, 

Let / 0 (x)=l. Then Eq. (4.49) gives 
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J xdx 

—i—=°- 

i* 

-i 

We then obtain from Eq. (4.48), /i(jc) = jc- Equations (4-51> and (4.52) give 
respectively 

I* 2 * 

*!.0 = T- -=-T 

f* 

-1 

and 

j Jxdx 

* 3 . 1 — 4 - =o 

J * 1<fe 

-I 

Then Eq. (4,50) yields f i {x) = x z -VX 
In a similar manner, we obtain 

| x?dx 

* 3.0 ^— \ -= 0 ’ 

J* 

-i 

i 

r A *** 

-1 3 

*3 .i=“T"—" = “V 

\jdx 

i 

[ J^(JC 2 -m)dx 

*3.2 = — ~ --= CL 

J (x 2 -V3 fdx 
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It is easily verified that 

Thus the required orthogonal polynomials are l,jc, jir-J/3 and x^ -(3/5)jc. 
These polynomials are called Legendre polynomials and are usually denoted 
by /^(x). It is easy to verify that these polynomials satisfy the orthogonal 
property (4,45). An important application of Legendre polynomials occurs 
in numerical quadrature (see Chapter 5), 

45 OUilC B-SPLINES 

We have seen that a curve passing through a given set of data points must 
be dependent on some interpolation formula or an approximating function to 
establish its relationship with the given data. The interpolation formulae 
(including the cubic spline formula) discussed so far are ‘global in nature*, 
since they do not permit local changes in the data or curve. 

The B-splines are 'non-global'. These are basis functions. This basis 
allows the degree of the resulting curve to be changed without any change 
in the data. The B-splines can be of any degree but, in computer graphics 
and other applications, B-spIines of degree 2 or 3 are generally found to be 
sufficient. We therefore restrict our study to a discussion of cubic B-splines 
only. The cubic B-spline resembles the ordinary cubic spline, discussed in 
the previous chapter, in that a separate cubic is derived for each 
interval. Specifically, a cubic B-spI ine (or a B-spline of order four), denoted 
by is a cubic spline with knots kj_ 4 , k,_] and k h which is 

zero everywhere except in ifie range k i-4 <x <i f . In such a case, B 4l (*) is 
said to have a support It may be noted that a B-spline need not 

necessarily pass through any or all of the data points. Similarly, a B-spline 
of order n (degree n — ]), denoted by ts nonzero only in the 

range k i _ /f <x<k t * *The theory for B-spiines' was first suggested by 
Schoenberg [1946] and a recurrence formula for its numerical computation 
was independently discovered by Cox [1972] and de Boor [1972]. The B- 
splines may be defined in several ways, A useful representation is that based 
on divided differences and this will be given in the next section. 

Let the set of data points be (jc Jt f = 1 , 2,..., and a £ x £ b. Let s(i) 

be the cubic spline with knots k u k^ . k pT where a<ki<k 2 <* <k p <h 

Then the cubic spline £43 (je) with knots ki r k^kj 7 k 4 and must satisfy 
the following properties: 

(i) On each interval, the B-spline must be a polynomial of degree 3 or 
less, 

(ii) The B-spline and its first-two derivatives must be continuous over 
the entire curve, 
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(in) Jt 4 5 (jf) > 0 inside i.e., fee B-spline is non-zero only over 

four successive intervals, 

(iv) Jf 4 S C 0 is identically zero outside [^,£ 5 ]- 

For computational purposes, it would be convenient to use fee normalized 
B-splisies, ,Y 4 j(*k defined by 

N 4t {x) = {k i -k i _ 4 }B 4i (x\ (4.55) 

The sum of all the normalized B-splines in fee given range is equal to i. 

Figure 4.1 shows fee graph of a cubic spline J 42 (x) with knots -2, “ 1 , 0 , 1 
and 2 , 



Fleur# 4.1 A typical cubic 6-spline, 
In Fig. 4.1, p B 4 2 (as) has fee following properties: 


(i) fl^ 2 (- 2 ) = S 4 , 2 { 2 ) = 0 and 1 

{U) j; 2 {-2)-£; 2 (2) = 0 

(iii) 


(4.56) 


Suppose now we have p knots denoted by jtj, fc p . To define the full 
set of B-spltnes, it is necessary to introduce ‘eight additional knots/ viz. 
k_$ y fc- 2 . *-ii % Jt^i, Jtp+j and kp+ 4 - These are chosen such that 

*l 3 < *_ 2 < k_ y < k§ = a and b = k p ^ < k^ 2 < < k^ 4 . (4.57) 

We now have (p + 4) B-splines (of order 4) in fee range a <>x<> b, and then 
the general cubic spline j(x). with knots has a unique 

representation^ in the range b, of fee form 

a * x * b - (4SS) 
r=l 

where N 4i (x) are the normalized B-splines of order 4 and a t are constants 
lo be determined. 
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4,5.1 Least-squares Solution 

To determine the coefficients a, in (4.58), we substitute x-x r and obtain 

p+4 

= ■= zl r wl, 2, (4.59) 

HI 

where p is chosen such that w » p + 4. In matrix form, Eqs. (4.59) can be 
written as 

Na- y t (4.60) 

where ^ is ajnn x (p + 4) band matrix and ct, y are column vectors. The 
solution of Eqs. (4.59) may be obtained by solving the normal equations: 

N t N(l= N J y, i.e. A r ct = y (4.61) 


4,5.2 Representations of B-spIlnes 

To define the cubic B-spline at x^k{, we first consider the five knots 
BfldJtf, where a < and <b. We also define the 

function 

/>»_{'* V, '™ P * !> (4 62) 

[ 0 when P £ 0. 

Then a unique representation of the cubic B-spline with knots V-4, —ft is 
given by (Greville (1968]) 

J 1 

S ij(x)=Y* a J xJ + 2 (4.63) 

J*0 »"f-4 

Unfortunately, the representation of the cubic spline* as given by (4.63), is 
computationally inefficient because of Loss of accuracy through cancellation. 
Another representation of the B-sphne, a traditional one, is through divided 
differences. The divided difference of fourth order of the function (k p -x) J 
with respect to the knots *i-4 and as arguments is denoted 

by ft-4ft-3ft-2ft-ift]“ We then have {see Section 3.10) 


■^4. i W ” ft-4 + ^-3* ^j-2> Vi* V" 


i^i-4 - V-aXV-4 “^- 2 X ^-4 “*H|X*H4 "V 

_ (* i - 3 ~*) + __ 

+ C*,-3-*<-lX*<-3 - *,) 


+ ■■■ + ■ 




ft ~ V-3XV - ^-2 X^i “*i-1) 


(4+64) 
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Setting 

* 4J {j t) = {x~k i ^)(x-k i _i)(x-k^ 2 )(x-k i _ l )(x-k<) (4.65} 

Eq> (4,64) can be expressed in the more compact form 


o w _ v 
*wM- 2_, -• 7Z 7 - 


(4.66) 


More genera l Ey; a B-spline of order n (degree n - l) is defined by 


where 


\ , cr)= t .*j= y y* 

= (*-*/-„)(*- Vn+l)-■ -C*'- 


(4.67) 


(4.6S) 

Recalling that 

*,, 3 , *,-2, t M . tj J*'-? 1 *-*’ *■-! > (4.69) 

*1 ” *1-4 


we obtain the relation 

n f4.701 

-- 7 -* 

K i " 

which is a recurrence relation. Similarly, for B-splines of order n, we 
obtain the relation 


3u<*)- (4.71) 

K ~ k l-n 

for a recursive computation of the B-splines Unfortunately, 

computational algorithms based on formula (4,70) or (4.71) have been 
found to be numerically unstable even for simple examples. However, algorithms 
based on a recurrence relation discovered independently by 
de Boor [1972] and Cox [1972] have been found to be both stable and efficient. 
This recurrence relation will be stated and illustrated in the next section. We 
conclude the present section with an example on the computation of cubic 
B-splines represented by (4.63), 

Example 4J& Using the relation (4.63), determine the cubic B-splmej(x) 
with support [0,4] on the knots 0,1,2,3,4. Show further that such a 
representation will be unique if j(l) is specified. 

Since jfx) is a cubic B-spline over [0,4], we have 
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j(0) = j{4) = 0 } 
5 '(0) = V(4)^0 
s"( 0)=j"(4) = G, 

Because of symmetry, we also have 


<i) 


J X2) = 0 (ii) 

j(d=j(3), m 

Now, on the interval [0, 1], let j(jc) be given by 

j(x> = c 0 + CjJC + c 2 x 2 + (iv) 

Since j(D) = 0 + we immediately have c 0 = 0. 

Also, the conditions /{0)=s r '(0)=0 given ^,=0 and c 2 =0. Hence (iv) 
becomes 


s(*) = ^je\ (v> 

which is the cubic spline on [0, 1]. Obviously, cj = f(l), Again, on the interval 
tO, 2], let j(x) be represented by 

*<*)*c^ + A(*-l)+’ (vi) 


where p\ is to be determined. Now, 

But s'(2) = 0. Hence we obtain 

12c 3 + 3j0| = 0, 


which gives 


A “-*<&* 

Substituting for $ in (vi), we obtain 


s(jc) = c 3 i J -4c 3 (j:-l)t 


(vii) 


which is the cubic B-sp line valid in the interval [0,2]. Further, let j(t) be 
represented on [ 0 , 3] as 

s(x} - c^x? - 4<^(x - 1 ) l + faix- 2 }* T (viii) 

But j(3) = 5 ( 1 ) = c y Substitution in (viii) gives 

Cj - 27c 3 - 32c 3 + fa , 

from which, we obtain 




Hence, (viii) becomes: 

**)=<*[** -4(*-l)i+6{x-2)i]. 


(ix) 
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Finally, let s(x) be represented on [0, 4] as: 

I(JC) = cjlr 1 - 4 (Jf -1)1 + 6<i - 2)1 ] + ft (x- . (x) 

Since j(4) = Q, eq.{x) gives 

0 = Cj(64-10S + 48} + ^, 

from which, we obtain 

fh = ~ 4c y 

Substitution in (x) gives the required B-spline as 

six) = C 3 X 3 - 4o 3 (j - \)l + 6c 3 {* - 2)J - 4c 3 (x - 3)1 t 
which will be unique if c 3 = s(l) is specified. 


4.5,3 Computation of B-spIinaa 

B-splines are most conveniently computed by the Cox-de Boor recurrence 
formula which is both stable and efficient. For B-splines of order n (degree 
r?“ 1), the formula is given by 




~^i-i 1 


(4.72) 


and holds for all values of x, For proof of this formula, see Cox [1972]. 
It is seen from (4.72) that the computation of (. x ) for any value of x 

depends on the values of ( _j(x) and j9 fl _| / (r). Thus, to compute tiie cubic 
B-spline based on the knots, k f _^ k i-2t , we need to compute, 

from left to right, the elements in the array: 


%-s 

%-2 



S V-2 



Hi 

flu -1 

H t 

Hi 





Further, advantage may be taken of the fact that some of the elements in 
the above array may vanish because of the properties of the B-spline For 
example, if then using the relation 



= 0 , 



if kj_\ < t x<kj 

- 

otherwise. 


(4.73) 
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the above army takes the form: 


®l/~a 

82,1-2 

0 £a,M 

0 

0 0 
0 

0 


The numerical computation of the B-spline$ will now, become more simplex. 
This is illustrated in the following example considered by Cox [1972]. 

Example 4,11 We consider knots 0,1,2,3,4, 5 ,6 and compute B-spliraes of 
order 6 (degree 5) at jc = 1 and r = 2 J.e. at the interior knots I and 2. 

Corresponding to j = 1, we have k 2 Zx<k y 
Then 


and we need to compute B&j- Consequently, we need to compute only the 
elements in the following array: 


0 

% a 

0 

0 

0 

0 


%3 

0 

0 

0 

0 


%4 

0 

0 

0 


0 

0 


^5,6 

%7 

0 


Using the Cox-de Boor formula, the values at x = l of the above B-splines 
are given by: 

Jj ( 3*1/2, $34=1/6, $ 4 >s =l/ 24 , B 4 ,6 S 0 T 

B 5 6 = 1/120, $ S7 =0 5 7 = 1/720 = 0.0013888.,., 

which is the same as that value obtained by Cox. 

Again, corresponding to x = 2, we have jt 3 £x<i fc 4 . Hence, 


and we require the value of B 6 7 at x = 2. 
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The elements to be computed 

are given in the following array: 

0 

0 

0 

33,4 




e 4,S 

fl l4 

%s 

0 5,S 

0 2,5 


®4,S %7 

0 

e 3,e 

S 5l7 

Q 


s 47 


The values obtained at x = 2 using the Cox-de Boor formula are given by: 

5^4" 1/2, ^2 5 =0 1 

i%4 = l/6, Bjj=U6, j£^ 6 = 0, 

$ ~ ^ ^4,6 = 1^24, 7=0, 

5^=11/120, % 7 = i/i2o f 

B 61 ~ 26/720 = 0.0361 111..., 
which is the same as that obtained by Cox, 

4.6 FOURIER APPROXIMATION 

The approximation of a function by means of Fourier series, i.e, by a series 
of sines and cosines, is found useful in applications involving oscillating or 
vibrating systems. Let the function fit) be a periodic function with period 
T> 0, i.e, let 

/(f + n = m {4.74) 

where T is the smallest value satisfying Eq. (4.74), Then the Fourier series for 
f(t) is written as 

/(0=y+2 (a„cos^+i>„sin^], (4.75) 

ft = I 

where <?„ and b n are real numbers independent of r and - 2 jt /T is called the 
fundamental frequency The coefficients 2trk/T,k=2 t are called 
harmonics. 

Integrating both the sides of (4.75) from 0 to 7, we obtain 
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since 

Hence 

T JO 

Again, multiplying both the sides of (4.75) by cas(2xnf/T) and then integrating 
from 0 to T, we get 




(4.77) 


since 


f r ( 2imt \ . f 2itnt} A 

IHtH— r =0 - 

Finally, multiplying both the side of (4.75) by 5tn(2jrHr/7') and then integrating 
from 0 to T, we obtain 



(4.78) 


Thus the coefficients Oq, a n end b„m the representation (4.75) are evaluated. 
If T~2jt, i.e. if /{!) is of period 2n t the formula {4.76 )h( 4.7S} become: 


1 f* 

4o=- /<*» 

jf J-* 

| fi* 

a n ^— | /(f)cos ntdt, ■ 
it J-jr 

l f* 

I /{f)sin n/ dt. 
it J-n 


(4J9) 


The Fourier series becomes further simplified if /(f) is an even or odd 
function. If f(t) is even* then we have 


where 


since 6^ = 0. 


AO - y + 

«—i 

a„ - — f fit) cos m dt, 
it Jd 


(4.80) 
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Similarly, if /(f) is an odd function, then we have 


where 


/( f ) = X 6„ sinn/, 

n=l 

2 f* 

b„-— I /(Osinnr di. 
ff Jo 


(4J1) 


since a 0 = - 0. 

The formulae (4J5M4.7S) can be expressed in a different way. For this, 
the well-known relations are used: 


COS 31/= 


itit --ini ml -mt 

e +e * . e-e 

and sm nt - - 


2 " 2 i 

Using (4J2), Eqs. (4.75 )h( 4,78) can be expressed as 


/(»>- A/^ n , 


<4.82) 


(4 83) 




where 


1 r Tf2 , i 

A p ~y ) Tn m e*** 17 *, J> = 0,1,2,... (4.84) 

These formulae directly lead us to the discussion of Fourier transforms but, 
before this, we consider an illustrative example on Fourier series. 

Example 4,12 Find the Fourier series of the function defined by 


m = 


-L, 

0, 

l 


-X < r < 0 
f = G 

0 < / < Xr 


The graph of the given function is shown in Fig. 4,2 
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From the graph, it can be seen that /(/) is an odd function. Hence the Fourier 
series for /(r) contains only the coefficients b n . We therefore have 

oQ 

K sin nt, 
a=] 


where 


If follows that 


2 t R 

b„ =— I /(f)sinflf dt 
x Jo 

2 r , , 

| sinrtfrff, since /(f) = I 
x Jo 


= — —cosnf 
jri n j 0 


nx 


, n = l, 3,5,... 
nx 


Z 4 4 ' l I 

—sin wf = — sin f ^“Sin 3f +-sin 5f, 
„ Wf x l 3 5 J 


4 ( . . 1 . 


n* ],y.“‘ 


1 . 


4.6.1 The Fourier Transform 

In the preceding section, we considered the Fourier series for periodic 
functions. There exist, however, several functions which are not periodic. 
Similarly* we come across, in nature, many phenomena (for example, lightning) 
which are aperiodic , He story of such phenomena is of great importance to 
the engineer. In such cases, the Fourier, transform is the applicable tool and 
this can be derived, from Eqs, (4,83) and (4.84), by making T approach infinity 
so that the function becomes aperiodic. When T ^ Eq. (4.84) can be written 
in the form 


f /(0(4.85) 
7-OS 

and is called the Fourier transform of /(f). Similarly* Eq. (4,83) is written as 
/(') = / r (4.86) 

£X J -Oj 

and is called the inverse Fourier transform of /(f). Equations (4,85) and (4 86) 
enable us to transform from time domain to frequency domain and from 
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frequency to time domain, respectively. Physically, F(ii^} represents the 
frequency content of the signal In Eq, (4.85), the function /(f) is given in 
the continuous form which is rarely the case with a signal In fact, the function 
/(f) is available only in a discrete form, i.e. /(f) is specified only at the points 
t n i - 0 t 12,—, tf-l, and At = 27Al Thus f k denotes the value of /(f) at 
t k . Then, corresponding to Eq. (4.85) and (4.86), we have: 


F p = £ A p = 0. u 1 .AT-1 0.87) 

Jr = 0 

and 

, 

f k = — ^F p * = 0, l (4.88) 

p=0 

Denoting 

W N =t 3MlM , (4.89) 

Eqs. (4.87) and (4.88) become 

fM 

F p ^Awjf, p = 0,\,2,-,N-i (4.90) 

*=0 


and 



* = 0 , 1 . 2 ,’ , tf -1 


(4.91) 


The above equations are* respectively, called the discrete Fourier transform 
(DFT) and the inverse DFT. Hey are the discrete analogues of Eqs. (4.85) 
and (4J6)* respectively. The coefficients |F p ] form a periodic sequence 
when extended outside of the range /» = &, 1, 2,.« f JV-l, and we have 

< 4 - 92 ) 


A useful analysis that is important in the practical applications of Fourier 
transform (such as smoothing of noisy data) is called the power spectrum 
which is a plot of the power versus frequency. If /(f) is a discrete-time 
signal with period then the power P Is defined py the relations 


. AM N-l 

'-tfI F * | *-I*f- 

1*0 


N-i 

II 

k*0 


Therefore, the sequence 

*=0,l,2, JV-l 


(4.93) 


(4.94) 
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is the distribution of power as a function of frequency and is called the 
power density spectrum of the periodic signal. The power spectrum is the 
plot of p k as a function of frequency o^k. Since F k (k = 0, I, 2, ..., N=4) is 
also a periodic sequence with period AT, it follows that the spectrum of 
F k (k =0, L t 2 is also a periodic sequence with period N. Hence, 

any N consecutive samples of the signal or its spectrum provide a complete 
description of the signal in the time or frequency domains. 

Example 4.13 Find the DFT of the sequence {1, 1,1* 1} for k = 0 T h 2, 

.... Af-L 

We have 

AM 

f p "E a w s t - © 

ft-0 

where 

w N = € ~ 2 ** w , (») 

since f k -1 for all fc = 0, I, jV- 1, it follows that 

«t = 0 A=0 

which is a geometric series of N terms with a common ratio of W $. We 
therefore have 


F i - ws ? 

f ~ 1 - 1 V$ = 1 -wg ! 


P=0, 1, 2, 1. 


(Hi) 


for p =* 0, it is seen that the ratio on the right side of (iii) is of the form 
Q/0. Hence we obtain its limiting value as N by using L/HospitaTs rule Similarly, 
for p - I, 2p N- 1, the limiting value of F p is calculated and is found to 
be zero. We thus have 

| A/, when p- 0 
P 1 0, when p- 1, 2, . .. y N -1. 


4.9,2 The Fast Fourier Transform 

The computation of DFT using Eq. (4.90) is inefficient because it does not 
make use of the symmetric and periodic properties of the factor vjz M 

W# 1 *-** =<W$)' and =Wjf ^Wj*^ (4.94) 

The direct use of Eq. (4.90) requires A/ 2 complex operations and also memory to 
store the values of fit) and W r jf w As N increases, the computation of DFT 
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demands very high memory requirements and becomes a complex and time 
-consuming process, 

A class of algorithms, called the fast Fourier transforms (FFT) , computes 
the DFT in an economic fashion using properties (4.94) and thereby reducing 
the number of operations to N log 2 N. This means that, in terms of computing 
time and memory requirements, the FFT is far superior to the DFT, For 
example, for jV = 50, the FFT requires about 250 complex operations compared 
to about 2500 complex operations required by the direct use of Bq, (4.90), 
This contrast, therefore, points to the importance of FFT algorithms. There 
exist several FFT algorithms and the basic idea behind all these is that a 
DFT of length M is decimated (or decomposed) into successive smaller 
DFTs. One class of FFT algorithms, called radix-2 algorithms, is based on 
the assumption that N is a power of 2. The decimation is carried out in 
either the time domain or frequency domain. Accordingly, we have two 
types of algorithms in this class, viz., (a) decimation-in-time (D1T), and 
(b) decimation-m-frequency (DIF). The Cooley-Tukey algorithm belongs to 
the type (a), whereas the Sandey-Tukey algorithm to the type (b). Both the 
algorithms require N log 2 N operations but differ in organization. The Cooley- 
Tukey algorithm is discussed in the next section. 

4,6.3 Cooley-Tukey Algorithm 

This algorithm assumes that N is an integral power of 2, Le. N * 2 m t where m 
is an integer. The basic idea of this algorithm is to decompose the //-point 
DFT into two jV/2-point DFTs, then decompose each of the M2-point DFTs 
into two ATA-point DFTs and continuing this process until we obtain Ni 2 
two-point DFTs. The number of steps required to achieve this is clearly m . 
For easy understanding, we present this algorithm for N - 8 and it will be 
seen that it is easily generalized. The first step {or stage) of the algorithm is 
described below: 

Let f Qi f } ,/j./ 7 be a sequence of values of /(/). The DFT for f k is 

given by 

7 

F P*Y, f * W *’ P-<U2,...,7 (4.90) 

where 

fr 8 =e _2j ^. {4.89} 

We split the summation on the right side of (4,90) into two equal pans of 
length 4, one containing the even-indexed values of /(f) and the other of 
the odd-indexed values. We therefore write 

VSA*f + lA»f. (4.95) 

t(tven) jt(odd) 
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Putting k = lr in the first sum and k - 2r + \ in the second sum of (4.95), we 
obtain 

F P = J/ir + S/^l Hf"*. <4.96) 


r*Q 


r=0 


But 


and 


jylpr 3 e ~2lwi(2pr)i& _ ^2mprt4 = typr j 


^ +1)P =w? p wf = . 

Using (4,97) in (4.96), we get 

3 3 

Fp =X A. ”7 + "VX/^ "?■ 


(4.97 a) 


(4.97 b) 


(4,98) 


f-*0 


r-0 


It is easily seen that the two sums on the right side of (4,98) represent 
4-point DFTs, Setting 


and 


3 

r=0 




rmQ 


(4.99a) 


(4,99b) 


Eq. (4.98) becomes: 


F p ^F;+W(F° t p = 0,12,3, (4.100) 

where F* and F p are the 4-point DFTs of the even and odd-indexed sequences 
defined by (4.99). This completes the first stage of decomposing the 8-point 
DFT into two 4-point DFTs, Further, to compute (4.100) for p = 4,5,6,7 
we use the formula: 

F P =FU* W * F U' P = +. s . 6 ’ 7 (4101) 

The computations involving equations (4.100) and (4,101) for the first stage 
of the 3-point DJT-FFT are shown in the flow-graph in Fig. 4.3. 
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Figure 4, J Rest stage of the appoint DIT-FFT. 

In the second stage, each of the 4-point transforms in (4,100) is decomposed 
into two 2-point transforms. We then write 

r=0 

+*/£/«« "S' 

j=0 f=Q 

= (4.102) 

where 

i i 

“ d (4.103) 

J*0 *=t> 

Similarly, we obtain 

F^F"+W{F^. (4.104) 

where 

■*» ^=X/« +3 »f- ( 4 -'° 5 ) 

i=o /-o 
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This completes the second stage of decomposition where each of the 
4-point transforms is broken into two 2-point transforms. The flow-graph of 
the second stage is shown in Fig 4.4. 



Figure 4.4 Second stage el tha decomposition. 
From Eq. (4.102), we have 


w i = A"? + A w f 


t=0 


and 


F? = - h w i * ft w{, 


t=<i 


(4.106a) 


(4.106 b) 


Equations (4.106a) and (4.106b) show that a! the third stage (which is the 
final stage, since N= 8), we obtain 

*T=/0. F T=f*' -T=/2. c=a- W- 107 ) 

It follows that, for the 8-point computation, we start with the input sequence 
A, A A A A A A and A* and then compute the various Fourier 
coefficients. These computations can conveniently be depicted in a flow graph 
{Fig. 4.5). 
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Figure 44 Flowgraph of an 6-point DIT-FFT. 

A close inspection of Fig* 4 5 enables us to make the following observations; 


(i) The input data is shuffled and are in the order t / 4t /j, , J\ T / 3 p / 3 , 

and fa . They are in the bit~rever$ed order, as shown in Table 4.2. 


Table 

4*2 Input Data in 

the Reversed Bits 


Input position 

Binary equivalent 

Reversed bits Index of the sequence 

0 

000 

000 

0 

! 

001 

100 

4 

2 

010 

010 

2 

3 

on 

110 

6 

4 

100 

001 

1 

5 

101 

101 

5 

6 

110 

Oil 

3 

7 

111 

111 

7 


(ii) The output data for the Fourier coefficients F k is in the natural order. 

fiii) The computations are carried out in terms of a fundamental molecule 
called butterfly, A typical butterfly is shown in Fig. 4.6, where i 
and j represent the position numbers in the stage and m represents 
the stage of the computation. 



Figure 4.6 A typical butterfly. 
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The outputs g* 1 * 1 and are given by 

_Uf T Ji+1 inr.fl fm -I na\ 

St =St +W N&j’ Sj = & ~ W hSj (4.1 OS) 

where r Is a variable depending on the position of the butterfly. 

The method of computation is illustrated in the foliowing numerical 
example. 

Example 4J4 Using the Cooley-Tukey algorithm, find the DPT of the 
sequence 

A =P. 13- 4> 4. 3, a, I}. 

We have 

< = h wtf = = (1-0/V2, 1F S 2 « C*- 2 "* ) 2 * -f, 

IF, 3 = -{1 + 0//2, JF fi 4 = -1, IF, 5 = -{l 
ftf -i, = (I + i>/2 

The D1T-FFT flowgraph for DFT computation is given below in Fig. 4.7: 
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Figure 4.7 Flowgrapb lor Example 4.14. 
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4-6.4 Sande-Tukey Algorithm 

This is an alternative approach and is a member of the class called decimation- 
in-Jrequency techniques. Effectively, it is the reverse of the Cooley-Tukey 
algorithm described in the previous section. However, in this case, the final 
results are scrambled. 

We start again with Eq. (4.90), viz., 

7 

p = 0,1,2.7 

and divide the sum in terms of the first and last four points as: 

i 1 

+ X / * w f- < 4|09 > 

*=*0 k= 4 


In the second sum on the right side of Eq. (4.109), we make a change of 
variable and write the equation as 

Pp-^h kt4) - («11 o) 

&=4J 


But 

= W*W* P = (-1 ) p wf, 

fl. ft A 8 

which is positive if p is even and negative, otherwise. 
Accordingly. (4.110) may be written as 



ft-0 


3 

=£(/i+/* + 4> 


1*0 


Wl 


for the even components, and 


r = 0. J, 2,3 


(4.111) 


*=0 

3 

=X<A -f^ w ^* w t 

k=0 


-£(/*-7*44) 


JU0 


r = 0, L 2, 3 (4 J12) 
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for odd components. From Eqs. (4.tU) and (4.112), it can be seen that hr 
and F^^ art the transforms of Lhe functions C/| + and 
(/* -/t+i)W^. respectively. We therefore set 

h*h^=H and (ft -fmW* =»*. U0.U3. (4.113) 

]n view of (4.113), Eqs. (4,111) and (4*112) assume the form 

F 2r = S r and F 2r+x *T r , r = G, 1, 2, 3. (4.114) 


It is dear that this approach can be repeated at the second stage to break 
each of the 4-point transforms into two 2-point transforms. In the general 
case, the final result is obtained after log 3 jV stages. Figure 4.8 shows the 
flowgraph for the 8-point decimation in frequency“FFT. 



h 

h 

h 

h 

h 

h 

h 

h 


Figure 4.8 shows that: 


(i) The input is in the natural order whereas the output for the frequency 
components is in the bit-reversed order. 

00 the computations can be carried out by using the butterfly structure. 


4.6,5 Computation of the Inverse OFT 

The inverse DFT is given by Eq. (4,91), viz. 

W-] 

i=o, 1.2,.«-]. 

p = 0 
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Comparison with DFT shows that the factors have changed signs, the 
input and output have interchanged and that the final output is divided by 
N. Hence the flowgraph for the calculation of DFT can also be adopted for 
the computation of inverse DFT after making the above changes. 

The Fast Fourier transform is extensively employed in many areas of 
electrical engineering such as signal processing. Hence, excellent software 
packages have been developed by MATLAB, IMSL* etc. Numerical Recipes 
discusses a number of FORTRAN programs. Any of these programs can 
conveniently be used as subprograms in the solution of research problems, 

47 APPROXIMATION OF FUNCTIONS 

The problem of approximating a function is a central problem in numerical 
analysis due to its importance in the development of software for digital 
computers. Function evaluation through interpolation techniques over stored 
table of values has been found to be quite costlier when compared to the 
use of efficient function approximations. 

Let /, / 2 , f n be the values of die given function and he 

the corresponding values of the approximating function. Then the error vector 
is e, where the components of e are given by = $ -*((,. The approximation 
may be chosen in a number of ways. For example, we may find the 
approximation such that the quantity + + is minimum. This 

leads us to the least squares approximation which we have already studied. 
On the other hand, we may choose the approximation such that the maximum 
component of e is minimized. This leads us to the ‘celebrated Chebyshev 
polynomials’ which have found important application in the approximation of 
functions in digital computers. 

In this section, we shall give a brief outline of Chebyshev polynomials 
and their applications in the economization of power series,* 

4,7.1 Chebyshev Polynomials 

The Chebyshev polynomial of degree n over the interval [-1,1J is defined by 
the relation 

T n (x) = cos (rt cos -1 *), (4,115) 

from which follows immediately the relation 

T n (x) = T_ n (xy (4.116) 

Let cos^'x = 6 so that x - cos 0 and (4.115) gives 

T n (jr) = cos n&- 


* Refer to Fox and Parker |196S] fur further details and ether applications of 
Chebyshev polynomials. 
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Hence 

7q 00 = 1 and 

Using the trigonometric identity 

cos (n -1)0 + cos (n + 1)0 = 2co$ n& cos 0, 

we obtain easily 

f n ,i { J > + ^n+i (*) = 2 x T„ (i>P 

which is the same as 

r n+1 U) = 2 xT n (x) - T n _ x {x). <4,117) 

This is the recurrence relation which can be used to successively compute 
all T a (*), since we know T^U) and 7](a). The first seven Chebyshev 
polynomials are: 


W = I 
T t (x)*x 
T 2 {x) = 2^-1 
T$ (a) = 4a 3 - 3x 
r 4 {jf) = 8jc 4 -8x 2 + l 

r 3 (jc)*16jr 5 -20x 3 +5jc 

T 6 (j)- 32x* -48x 4 + I&r 2 -L 


(4.118) 


The graph of the fim four Chebyshev polynomials are shown in Fig. 4.9 



Figure 4,9 Cbebyabev polynomials T n (*), p*t 2, 3, 4. 


It is easy to see that the coefficient of x H in T^f#) is always 2"~\ Further, 
if we set y =7], (a) =cos n& r then we get 


dy nsin nQ 
dx sin0 
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and 

d 2 y _ -n 2 cos nff +■ n sin nO cot# -rP'y + xjdyidx) 
dx* ~ sin 2 8 ~ 1-r 2 

so that 

= ^ <4,119) 

dx dx 

which is the differential equation satisfied by TJ,tJc)- 

It is also possible to express powers of x in terms of Chebyshev 
polynomials. We find 

l«*oM 

x = T x (x) 

I 1 -i[r 0 W+r 1 (*)] 

^=I [371w+ r 3W ) f412fl) 

* 4 -;Pr # (*)+4r 2 (x)+r 4 (*)] 

5 

X s =±[ior l (x)+5r,(jc}+r ; (x)] 

10 

X 6 = ^[10r 0 U> * 152j (*) + 6J 4 (x) + r 6 (x)]. 

and so on, These expressions will be useful in the economization of power series 
to be discussed later. 

An important property of r n (x) is given by 


f T m (x)TMdx 

l ? ’ 

that is, the polynomials T^fr) are orthogonal with the function l A/0 - x 2 ). This 
property is easily proved since by putting x = cos 6, the above integral becomes 

>f jf 

j 7^(cos 6} (cos &)d&- J cos w#cos n& d& 
o o 

nff 

sin(ffi + n)& sin(jw-w) 0 
2(m -f n) 2(m-ri) 

from which follow the values given on the right side of (4.121). 



0 , m*n 

ff/2, m = « * 0 (4,121) 

n, m - n -0 
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We have seen above that T n (x) is a polynomial of degree n in x and that 
the coefficient of y* in T^je) is 2*" 1 . In approximation theory, one uses 
manic polynomials* Le. ChetrysHev polynomials in which the coefficient of x n is 
unity. If f (i) is a monk polynomial* then we can write 

p n (x)= 2 , -"r (i d), (4,122) 

A remarkable property of Chebyshev polynomials is that of all monk 
polynomials, p ra (x), of degree n whose leading coefficient equals unity, the 
polynomial '2}~ n T h {x) i has the smallest least upper bound for its absolute 
value in the rang (-1* !). Since |r„(x)j<h the upper bound referred to 
above is 2 l_n . Thus, in Chebyshev approximation, the maximum error is 
kept down to a minimum. This is often referred to as mini max principle and 
the polynomial in (4,122) is called the minima* polynomial. By this process 
we can obtain the best lower-order approximation, called the minimal 
approximation, to a given polynomial. This is illustrated in the following 
example. 

Example 4JS Find the best lower-order approximation to the cubic 
2* 1 +3x*. Using the relations given in (4.120), we write 

2x? +jx 2 = ? irj<x)+3j;(x))+3** 

4 

-s* 1 +!*(*)+jTiM 

= 3* 1 +^-x+^?j(x), since ?j (x) = x- 

The polynomial 3x 2 + {3/2)x is the required lower-order approximation to the 
given cubic with a maximum error ±1/2 in the range (-1, 1). 

A similar application of Chebyshev series in the economization of power 
series which is discussed next. 

4,7,2 Economization of Power Series 

To describe this process, which is essentially due to Lanczos, we consider 
the power series expansion of /(jc) in the form 

/(jc) = ^ + Apx + Ayr?’ + ---trA n x n , (-1 £ * £ 1), (4.123) 

Using the relations given in (4.120), we convert the above series into an 
expansion in Chebyshev polynomials. We obtain 

/(*) = ^ (x) + BfF % (x) + ■ ■ ■ + B n T„(x\ (4. 124) 

For a large number of functions, an expansion as in (4.124) above, converges 
more rapidly than the power series given by (4.123). This is known as 
economization of the power series and is illustrated in Example 4.16. 
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Example 4.16 Economize the power series 

x* r 7 

sin x v x - — + — - . 

6 120 5040 

Since 1/5040 = 0.000198, the truncated series, viz,, 

x? x* 

sin*® x™ +- 

6 120 


(i) 


will produce a change in the fourth decimal place only. We now convert the 
powers of x in (i) into Chebyshev polynomials by using the relations given 
in (4*120). This gives 


siitjc w [3Fi(x) +J\(i)3 +—-7 

lv / 24 i ik n i20k16 

Simplifying the above, we obtain 


[10Jj(*)+5r 3 (*)4T 5 <x)). 


Since 1/1920 = 0,00052,,,,the truncated series, viz., 

sin x = — r.(Jt) — —T, (x) fiifl 

192 |W 128 3 ' K } 

will produce a change in the fourth decimal place only. Using the relations 
given in (4.US), the economized series is therefore given by 

169 5 ,. 3 , . 383 5 3 

tin Jr * •—*- —- (4* -3x) = —— jr-—x . 

192 128 384 32 


EXERCISES 


4.1. Fit a straight line of the form Y = oq + OfX to the data: 

x y x _ y 


1 

2.4 

4 

4.2 

2 

3.1 

6 

5.0 

3 

3.5 

8 

6.0 


4.2, Find the values of ^ and q ( 

so that Y + 0 (jc fits the data given 

in the table: 

X 

y 

0 

1.0 

1 

2.9 

2 

4,8 

3 

6,7 

4 

8,6 
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4,3* If the straight line y = ^ * a { x is the best fit to the set of points 
<*!,>■)), WJ *e& show ** 


X 

y 

I 



Zx t 


n 

=o T 

c*«1 2 .")■ 

E*? 

lyf 

Zx, 




4.4. Use the method of least squares to fit the straight line ¥ = a + bx to 
the data 


X 

y 

w 

0 

2 

1 

1 

5 

i 

2 

8 

i 

3 

11 

i 


Find the values of a, h and c so that ¥ = a + bx + ex 2 is the best fit 
to the data 

X 

y 

0 

i 

1 

0 

2 

3 

3 

10 

4 

21 

The table below gives the temperatures F(in 0°C) and lengths / (in 
mm) of a heated rod. If / = ^ + 0 | 7 \ find the values of and 

using linear least squares 

f 

/ 


40 

600.5 

50 

600.6 

60 

600.8 

70 

600=9 

80 

601.0 


4.7. Determine the normal equations if the cubic polynomial 

7 = ^ + ayx + + nj * 3 is fitted to the data (jj, y t \ i - 0 , 1 , 2, 

4.8, Find best values of a^at andaj so that the parabola y^a^+a^x+a^x 1 
fits the data; 
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x y x y 


LO 

1,1 

3,0 

2.8 

IS 

1.2 

3.5 

3.3 

2.0 

IS 

4,0 

4,1 

2.5 

2.6 




4.9. Determine the constants a and b by the least-squares method such 
that y = ae hx * fits the following data: 


X 

y 

LO 

40, no 

1.2 

73.196 

1.4 

133J72 

L6 

243,02 


4.10. Fit a function of the form y = ax h to the following data: 


4,11. 


4.12, 


x 

y 

X 

y 

2 

43 

20 

8 

4 

25 

40 

5 

7 

18 

60 

3 

10 

13 

80 

2 

Fit an exponential function of the type y = ae b * to the following data: 

X 

y 

J£ 

y 

0 

0.10 

L5 

9,15 

0.5 

0.45 

2.0 

40.35 

LO 

2,15 

2.5 

180.75 

The curve y -cJ** is fined to the data: 


X 

y 

X 

y 

1 

L5 

4 

40,1 

2 

4,6 

5 

125.1 

3 

13.9 

6 

299,5 


Find the best values of c and b. 

4.13. Fit a function of the form y = A^e^ 1 + Ayfo* to the data given in 
the following table: 
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JC 

y 

JC 

y 

LG 

1.175 

1.5 

2.129 

1.1 

1.336 

1.6 

2.376 

1.2 

1.510 

1.7 

2,646 

1J 

1.698 

1.8 

2.942 

1.4 

1.904 




4.14. Fit a natural cubic B-spline, s, to the data-2, —1,0, 1,2. Show also 

that j is unique if s<-l> is prescribed. 

4. IS. Given the set of knots G t 1 T 2, 2,4,5* 6* evaluate the B-spline of order 
6 at each of the Interval knots by the divided difference method. 

4-16. Prove the Cox-de Boor recurrence formula given by (4.72). 

4.17. Repeat Problem No. 15 using the Cox^de Boor recurrence formula. 

4.18. Find a Fourier series approximation to the function defined by the 
graph in Fig. 4.10. 



4 J 9 ♦ Compute the FFT of the sequence {1*2, 3, 4,4,3,2* 1} using Saitde- 
Tukey algorithm. 

4 JO- Compute the FFT of the function /(f) defined by the points / 0 = f 

A = -I. h = -1* h =- [ > A =J. A = I* A - v A - H the 

Coofey-Tukey algorithm. 

4,21. If is any polynomial of degree n with leading coefficient 
unity, then prove that 


max 


LM 

2 fl _ ] 


* ftwi- 

-ISj si 


4.22. Prove that r l s l/2[r 0 <x) + T 2 {jc)]. 

4.23. Prove that T w (x) is a polynomial in Jr of degree n. 
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4.24, Prove that the coefficient of x n in T^jc) is 2" -1 , 

4.25, Express the following as polynomials in jc: 

(a) JiU) + 27iU) + r 1 ( J ) 

<b) 

4 8 

4.26, Express the following polynomials as sums of Chebyshev polynomials: 
( a) l + * ^ jr + jr 3 

(b) l-x 2 + 2x 4 . 

4.27, Obtain the best lower-degree approximation to the Cubic x J + 2x 2 . 

4.28, For x nearer 1, the sum 


- , X 2 x 1 x 4 X 5 X 6 X 7 

S- 1 -*+—-*+-— + -- 

2 6 24 120 720 5040 


gives a result which is correct to five decimal places. Economize 
die above series if the fourth decimal place is not to be affected, 

4,29- Economize the senes 


. , JE 3 Jt 5 Jt 7 

sinhr-x+“ + “ + —, 

6 120 5040 

on the interval [-1,1], allowing for a tolerance of 0*0005, 
4*30, Economize the series given by 

jc 2 - — x 3 . 

2 8 16 
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Numerical Differentiation 
and Integration 


5.1 INTRODUCTION 

In Chapter 3, we were concerned with the general problem of interpolation, 
viz., given the set of values (x^, j^,), (*,. yj),,.*, y H ) of * and y , to find 
a polynomial $(x) of the lowest degree such that /(jc) and agree at 
the set of tabulated points. In the present chapter, we shall be concerned 
with the problems of numerical differentiation and integration. That is to 
say, given the set of values of x and y f as above, we shall derive formulae 
to compute; 

(j) fLZ ... for any value of x in [*q,x,, 3, and 
tk dx 2 
X* 

(it) | ydx, 

5.2 NUMERICAL DIFFERENTIATION 

The general method for deriving the numerical differentiation formulae is to 
differentiate the interpolating polynomial. Hence, corresponding to each of 
the formulae derived in Chapter 3, we may derive a formula for the derivative. 
We illustrate the derivation with Newton’s forward difference formula only, 
the method of derivation being the same with regard to the other formulae, 

187 
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Consider Newton's forward difference formula: 


2 «{tf-l)(a-2) .j «n 

> = y 0 -i-nAy 0 + ^ Ay 0 +- --A >&+■••, pl) 


where 

Then 




dy tfydu if, 2a “ 1 ,2 3u 2 “6i#+ 2 .* ^ 


(5.2) 


(5J) 


This formula can be used for computing the value of dyfdx for non-tabular 
values of x. For tabular values of x t the formula takes a simpler form, for 
by setting x -jcq we obtain u- 0 fern (5,2), and hence (5.3) gives 


.1] ^=5 (* 4 i2>, ° 4 aVo 4 iVo+ ) 


Differentiating (5.3) once again, we obtain 

d 2 y 1 f , 2 6«»6 a3 12 h 2 -36u + 22 

“F A * + “ A * + -»-* >0 + 


(5.4} 


(5.5) 


fern which we obtain 


€Z. 


(5-6) 

- 


Formulae for computing higher derivatives may be obtained by successive 
differentiation. In a similar way, different formulae can be derived by starting 
with other interpolation formuale. Thus, 

(a) Newton's backward difference formula gives 


[*L = K 7 *4 vl *4 vV - 


(5.7) 


and 


[$] -?(^* + ** + ib** + !** + “) (58) 

L J x=x„ 


(b) Stirling’s formula gives 


~4)f\ _ I f Ay_, +Ay 0 t_A* 

*-L*~*l 2 ‘6 " 


^ 1 AV 3 +A 5 y. z 


10 


(5.9) 
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and 


£1 

dx 2 


= ^(aV-, “A-Z + ^AVz - ••} (5- 10 > 

■J 


If a derivative is required near the end of a table, one of the following 
formulae may be used to obtain better accuracy 


*-( A -i 4, 4 4, “i 4 S A, -i 4,+i ~)* 

=(& + U 2 -iA 3 + -U 4 --U J +J-A 6 - 

2 6 12 20 30 


CS.11) 

(5.12) 


AS-Ia 2 -A J + -A< --A s + —A* --La’ + ^A* — -U (5.13) 

0 { 12 6 180 10 560 ) 1 

(Yl l A 4j 13 ,6 11 »7 29 a ^ V. 

l 12 12 180 180 560 ) y } 

V,=(v + iv I +iv 3 + iv 4 4 v5+ i 7 ‘ + | vT+ i v * + "Y’ <5 lS) 

- 1 Av 1 ~iv 3 -—v 4 - J-v 5 -A-v* -A-? 7 -—v 8 --1 v 

I, 2 6 12 20 30 42 56 /'* 1 

(5J6) 

h l y” ^ fV a + V 3 + iiV 4 + -V 5 +—V 6 + -A V 7 + — V s +'Ay„ (5,17) 
^ { 12 6 180 10 560 )* 


-[ V 2 - A.y* - J-V 5 - 


iv 5 -Altf 6 _ Jl^ 7 — V s -».ly Jwli (5* 18) 

12 180 180 560 f** 1 

For more details, the reader is referred to Interpolation and Allied Tables, 
The following examples illustrate the use of the formulae stated above. 

Example 5.1 From the following table of values of jc and y, obtain dy/dx 
and Syfdx* for jc m 1.2: 


x y x _ y 


1.0 

2,7183 

1J 

6,0496 

1.2 

3.320 L 

2.0 

7J891 

1.4 

4.0552 

2.2 

9.0250 

1.6 

4.9530 
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The difference table la 


X 

¥ 

A 

A 2 

A* 

A 4 A* 

A 6 

1.0 

£.7103 

0.601 B 






3.3201 

0.7351 

0.1333 

0.0294 



1,4 

40552 


0.1627 


0.0067 




0.8976 


0,0361 

00013 


1,6 

40530 


0.1968 


0-W80 

0.0001 



1,0966 


0,0441 

0,0014 


1,8 

60496 

1.3396 

0,2429 

0,0635 

0.0084 


2,0 

7.3801 

1.6359 

0.2964 




22 

9.0260' 






Here jco 

11 

k> 

£ 

= 3,3201 and A = 0.2. Hence (5+JJ) gives 




0.7351 ~^(0.1627) + ~ (0.0361) - ^ (0.0080) + ^ (0.0014) 


= 3J201 


If we me formula (5,12)> then we should use the differences diagonally 
downwards from 0.60)8 and this gives 


\±] =-L[ 0 , 


6018+^(0.1333) -1{0.0294) + 4(0««7) 
2 6 12 


-—<0.00131 
2CT J 


-3,3205, as before. 
Similarly, formula (5.13) gives 




1 


u^-L.2 004 

Using formula (5.14), we obtain 

U\ 

J i=.i 


0.1627 - 0.0361 +jko.0080}-§{0.0014) 
12 6 


= 3.318. 




= — [o.!333-“ 

U 0 04 1 11 


(0.0067)+-^(0.0013) | = 3.32. 
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Example 5.2 Calculate the first and second derivatives of the function 
tabulated tn the preceding example at the point x-2.2 and also dyldx at 
x = 2.0. 

We use the table of differences of Example 5,1. Here t n = 2.2* y H = 9.0250 
and h -0,2. Hence formula (5,15) gives 

1.6359 + - (0.2964) + - (0.0535) + - (0.0094) + - (0.0014) 

2 3 4 5 ^ 



= 9.0228. 


r- 

TH 

L.. .. 

1 

w\ 

- "0.04 . 
1 ^ 2.2 


0,2964 + 0.0535 + jl (0,0094) + -(0.0014) j* 


ij* 8.992. 


To find dyfdt at x - 2,0 T we can use either (5.15) or (5.16). Formula (5,15) gives 

\±] =-L[., 

UJ^o 0.2 L 

*] 


.3395 + 1(0.2429) + 1(0.0441) + 1(0.0080) 


+1 (0.0013) + - (0,0601) | 
5 6 


= 7,3896. 

whereas from formula (5.16), we obtain 


|>1 ^_L[ 


1.6359 -1 (0J964) -1 (0.0535) - — (0.0094)-— (0.0014) 
2 6 12 20 


S3 7.3896. 


Example 5.5 Find dy/dx and cPyldx 1 at x - 1 ,6 for the tabulated function of 

Example 5J. 

Choosing =1.6, formula (5.9) gives 

f dyl J_ ( 0.8971 - 1.0966 _ l 0,0361 + 0.0441 J 0. 0013+ 0 .0014h 

L*W«L 2 “ 2 2 + 30 2 J 

= 4.9530. 


Similarly, formula (5,10) yields 


d 2 y 


dx* 


J x«il.6 


' 0,04 


0.1988 - —(0.0080) +—10.0001); = 4.9525. 


12 


90 
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In the above examples* the tabulated function is e* and hence it is easy to 
see that the error is considerably mote in the case of die second derivatives. 
This is due to the reason that although the tabulated function and its 
approximating polynomial would agree at the set of data points, their slopes 
ai these points may vary considerably. Numerical differentiation, is, therefore, 
an unsatisfactory process and should tie used only in "rare cases/ The next 
section will be devoted to a discussion of errors in the numerical differentiation 
formulae. 


5.2.1 Errors in Numerical Differentiation 


The numerical computation of derivatives involves two types of errors, viz. 
truncation errors and rounding errors. These are discussed below. 

The truncation error is caused by replacing the tabulated function by 
means of an interpolating polynomial. This error can usually be estimated 
by formula (3.7). As noted earlier, this formula is of theoretical interest 
only, since, in practical computations, we usually do not have any information 
about the derivative However, die truncation error in any numerical 

differentiation formula can easily be estimated in the following manner. 
Suppose that the tabulated function is such that its differences of a certain 
order are small and that the tabulated function is well approximated by the 
polynomial {This means that the tabulated function does not have any rapidly 
varying components.) From Table 3.4 {p. 71), it is then clear that 2s is the 
total absolute error in the values of 4^ in the values of £?y it etc., 
where $ is the absolute error in the values of y t . Consider now, for example, 
Stirlings formula (5.9). This can be written in the form 


dy _ AP-t + A )fr } r 
dx ^ 2h 


yi-y -1 

2 h 


+ 7i> 


( 5 . 19 ) 


where T,, the truncation error, is given by 


Tt 


_±_ 

6h 


2 


< 5.2 0 ) 


Similarly, formula (5.10) can be written as 


y 







(5.21) 


where 


The rounding error, on the other hand, is inversely proportional to h in 
the case of fust derivatives, inversely proportional to h 2 in the case of 
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second derivatives, and so on. Thus rounding error increases as h decreases. 
Considering again Stirling’s formula in the form of (5.19), the rounding 
error does not exceed 2ef2.fi = sfh, where e is the maximum error in the 
value of jv On the other hand, the formula 


"4^1 Ay_ L + A)fr i t 


_ y-i-*y-i+*yt-yi 

12 h 


(5.23) 


has the maximum rounding error 

!5£ = 2£ 

Finally, the formula 

-tfy-i , - y-<-2ya+y> , ( s. 2 4) 

dx 2 h 2 h l 

L. J jm 

has the maximum rounding error 4It is clear that in the case of higher 
derivatives, the rounding error increases rather rapidly. 

Example $.4 Assuming that the function values given in the table of 
Example 5.1 are correct to the accuracy given, estimate the errors in the 
values of dyidx and cFytdx 2 at x ■ 1,6. 

Since the values are correct to 4D, it follows that e < 0,00005 =* 0.5 * 10” 4 . 

Value of dy/dx at x - 1.6: 


Ihmcation error = — 
6 k 


AV, +A 3 ,Vo 


, from (5.20) 


0,0361+0.0441 


and 


6 ( 0 , 2 ) 2 

= 0.03342 

3e 

Rounding error = -—from (5.23) 
2 h 


3(0.5)10" 

0.4 


-0.00038. 
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Hence, 

Total error = 0,03342 + 0,00038 = 0.0338. 

Using Stirling's formula form (5J9)„ with the first differences, we obtain 


(d}A _ Ay.j + 0.8978+1,0966 _ 1.9944 4 




**- 1.6 


2 h 


0,4 


0,4 


9860. 


The exact value is 4,9530 so that the error in the above solution is (4,9860 - 
4,9530}* i.e. 0-0330* which agrees with the total error obtained above. 

Value oftfiy/th? at x - L6 . Using (5.24), we obtain 


£y 

dx 1 


A Vi 0.1988 , 

= —;— = _ _ . 53 4.' 


- 004 

so that the error ~ 4,9700 - 4,9530 - 0.0170, 
Also* 

1 , l 


9700 


Truncation error — - —- [A 4 _y_ 2 j - 


\2h 


12(0.04) 


-x 0.0080 = 0.01667 


and 


D 4s 4x0.5x10 

Rounding error =—-■ 

h * 


0.04 


: 0.0050. 


Hence 


Total error in 




-0.0167 + 0.0050 = 0,0217. 




5.2.2 The Cubic Spline Method 

The cubic spline derived in Section 3.14 can conveniently be used to compute 
the first and second derivatives of a function. For a natural cubic spline, the 
recurrence formulae (3.108) or (3.109) may be used to compute the spline 
second derivatives depending upon the choice of the subdivisions. Then 
Eq. (3.106) gives the spline in the interval of interest* from which the first 
derivatives can be computed. For the first derivatives at the tabular points, 
it would, of course* be easier to use formulae (3.105) and (3.107) directly. If, 
on the other hand, end conditions involving the first derivatives are given* 
then recurrence formulae (3.111) or (3.113) may be used to compute the 
remaining first derivatives. 

The following example illustrates the use of the spline formulae in 
numerical differentiation. 

Example 5.5 We consider the function y(jc) = sm x in [0,jr]|, 

Here = 0. Let N -2, i.e, h = x/2. Then 

>b — ¥% = 3^ = 1 and - 0. 
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Using formulae (3.109), we obtain 

Afq + 4Af| + M 2 ~ — (jfy - 2)\ + y 2 ) 
h 
or 


M : =- 


11 


Formula (3.106) now gives the spline in each interval- Thus, in 0Zx£xJ2, 
we obtain 


which gives 


Hence 



(i) 


Exact value of = cos jr/4 = IA/2 = 0.70710681. The percentage 
error in the computed value of s'{nW) is 128%. From (i). 


and hence 



j'f- = — = -~ = -0.6079271C. 

Ui b- 3 4 x 1 


Since the exact value is “1A/2, the percentage error in this result is 14.03%. 

We now consider values of y-s\n x in intervals of 10° from j = 0 to 
n. To obtain the spline second derivatives we used a computer and the 
results are given in the following table (up to x “ 90 fl ). 


rm 


x{ln degrees) 

£wscf 

Cubiis spfim 

10 

-0.1736401TB 

-0.174 089 426 

20 

"0.342 020 143 

-0.342 869 233 

30 

-qsooqqqqqq 

-0601 270 624 

40 

-0,642 707 610 

-0.644 420 964 

so 

—0,716 044 443 

—0.767 990 999 

60 

-O.JKJ0O25 4O4 

-0.860226 016 

70 

-0,939602 621 

-0.942 000 42S 

SO 

-0,964107 763 

"0.987 310 197 

■90 

-1.000 000 000 

-1.002541 048 
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H is seen that there is a greater inaccuracy in the values of the spline second 
derivatives. 

5.3 MAXIMUM AND MINIMUM VALUES OF A TABULATED 
FUNCTION 


It is known that the maximum, and minimum values of a function can be 
found by equating the first derivative to zero and solving for the variable. 
The same procedure can be applied to determine the maxima and minima 
of a tabulated function. 

Consider Newton’s forward difference formula 

. jP(p-l) . 2 p(p-1){p- 2) .3 

y = y® + p&y® + 2 & y<> + 6 & y<> * ■ ■ * 

Differentiating this with respect to p, we obtain 


dy 

= = % + 
dp 


. 3 p -3 f + 2,a 


-A^„ + 


A yo + r 


(5.2S) 


For maxima or minima dyfdp = 0. Hence, terminating the right-hand side, 
for simplicity, after the third difference and equating it to zero, we obtain 
the quadratic for p 


where 


and 


c 0 +c 1 p + c 2 P 2 = 




Ci-A 2 y 0 -A J y Q 


1 A j 

c 2 =~A*yQ. 


(526) 


{5.27} 


Values of x can then be found from die relation x = x$ + ph. 

Example 5.6 From the following table, find x t correct to two decimal 
places, for which y is maximum and find this value of j?. 


X 

y 

1.2 

0.9320 

1.2 

0.9636 

1.4 

0.9855 

1,5 

0.9975 

1,6 

0.9996 
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m 


Jf 

y 

A 

A 2 

12 

04320 

0 0316 


ij 

0.9636 

0.0219 

- 0,0097 

1,4 

0.9655 

0.0120 

- 0.0099 

1.5 

0,9975 

0.0021 

= 6,0099 

1.6 

0,9996 




Let xq = 1.2* Then formula <5.25), terminated after second differences, gives 

0 = 0.0316 + —(-0.0097) 

from which we obtain p = 3, S, Hence 

i = *0 + ph = U + (3 4) (0. L) -1.58. 

For this value of x, Newton's backward difference formula at = 1.6 gives 

-0 2f-0 2 + 11 

y( l .58) = 0.9996 - 0,2(0.0021) + ^ J (-0.TO99) 

m 


= 0.9996-0.0004+0.0008 

= 1.0. 


5,4 NUMERICAL INTEGRATION 

The general problem of numerical integration may be stated as follows. 
Given a set of data points fa, jfaXfatJfc), ■'-*{*** J^) a fimction y * f(x\ 
where f{x) is not known explicitly, it is required to compute the value of 
the definite integral 


b 

!=]ydx. ( 5 . 28 ) 

As in the case of numerical differentiation, one replaces f(x) by an interpolating 
polynomial #x) and obtains, on integration, an approximate value of the 
definite integral. Thus, different integration formulae can be obtained depending 
upon the type of the interpolation formula used. We derive in this section 
a general formula for numerical integration using Newton T s forward difference 
formula. 

Let the interval [a, b\ be divided into n equal subintervals such that a = ^ 
<*] <x 2 <<x„- b. Clearly, x n = jc@ +nh. Hence the integral becomes 
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■% 


Approximating y by Newton's forward difference formula, we obtain 

/-)[*,+pa*, P(P-1)(P-2) a3j , o 
L 

Since x = + ph 3 = A dp and hence the above integral becomes 

I ~ h J [■**» + pAy ° * ~ ? 2 1 ' &2y<> + ^ 6^ ~ A3 - V ° + “•] 

which gives on simplification 

| + " ( ” 2 ~ 2) A^o +- | < 5 - 29 ) 

From this general formula^ we can obtain different integration formulae by 
putting n = f 2, 3, + .,*etc, We derive here a few of these formulae but it 
should be remarked that the trapezoidal and Simpson's 1/3 rules are found 
to give sufficient accuracy for use in practical problems, 

5.4.1 Trapezoidal Rule 

Setting n - 1 in the general formula (5,29), all differences higher than the first 
will become zero and we obtain 

] = + = + = + {5.30) 

*a 

For the next interval 0^ * 2 ] t we deduce similarly 

”1 y*=|(»+/i) (5.31) 

and so on. For the last interval we have 

| (5 32 ) 

*w-l 
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199 


f h 

J ydx=-[y® + 2 (y\+y 2 + ■+>v-t) + J'J* (5-33) 

*Q 

which is known as the trapezoidal rule. 

The geometrical significance of this rule is that the cum y- fix) is 
replaced by n straight lines joining the points and J'i) 

and (* 2 , 0<h-ip JVj) and y n }- The area hounded by the curve 

y - f(x), the ordinates x = x$ and x - x n> and the i-axis is then approximately 
equivalent to the sum of the areas of the n trapeziums obtained. 

The error of the trapezoidal formula can be obtained in the following 
way. Let y- f{x) be continuous, well-behaved, and possess continuous 
derivatives in Expanding > f in a Taylor's series around x = Xq, we 

obtain 


J ydx= | y 0 +(x-Jt 0 )ri + - ^- y 0 ' + - 

*Q *o L 


dx 


, h 2 , f? „ 

= *Vo +~>'C + -T>S +- 
L 0 


(5*34) 


Similarly; 

=^ro +yo +A*o + y J<ff+y-Vo'+'-j 

-*+y* + 7* + ™ <5js> 

From (5.34) and (5.35), we obtain 


1 y - ~ (>'o +yO- -jrk*yS +■ - (5 36 > 

J 2 12 
*0 

which is the error in the interval [je^, jt|] r Proceeding in a similar manner we 
obtain the errors in the remaining sub intervals, viz., [x t > x 2 ],[j^ r and 
[Xg_g, Xj|]. We thus Have 

£ = -yA 3 M+^'+-+y^,). (5-37) 

where £ is the total error. Assuming that / H (x) is the largest value of the 
quantities on the right-hand side of (5.37), we obtain 
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= (5,38) 

since nh^b-a. 


5.4,2 Simpson's 173-Rule 

This rule is obtained by putting n = 2 in Eq, (5,29)* i-e, by replacing the 
curve by n/2 aits of second-degree polynomials or parabolas. We have then 

J y^ = 2A^+A^ + ii 2 j^^-|(y 0 + 4y,+>^) i 

Similarly, 

\ yd£ = ^{y 1 +4y i + y 4 ) 

*3 


and finally 


) 


Summing up, we obtain 


ydx = - Cy^ 2 + 4y Jt _ l +y h ), 


] ^^ = 5(y&+40|+y 3 + y J + - +y„_ l ) 


(5,39) 


+2(yi+y4+y6+ +y n -2)+y n l 


which b known as Simpson’s \B-rule, or simply Simpson’s rule. It should 
fee noted that ills rule requires the division of the whole range into an even 
number of subintervals of width h. 

Following the method outlined in Section 5,4J, it can be shown that the 
error in Simpson’s rule is given by 
b k 

/ y dx = -b* +40i + ■ + y„.0 


+ 20*2 + y* +y$ +■•■+jvjJ+J'J 

where y n (x) b the largest value of the fourth derivatives. 


(5.40) 
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5.4,3 Simpson's 3/6-Rule 

Setting n = 3 in (5.29) we observe that all the differences higher than the 
third will become zero and we obtain 

= Ik |Vo + ^ - Jto) + ^ 0*2 _ 2>t + + ~0h “ 3^2 +3.vi - yo ) 

3h 

s y 0<? + b’i +3 

Similarly 


| yc& = y(^+3^4+3>' J +> 6 ) 

*5 

and so on. Summing up all these, we obtain 

*n ^ 

J J^-ytOb+ty +3^+^) + (^+3> 4 + 3y s + ^) + 

*Q 

+ O fl -3 + 3 y n - 2 +b n -i +>W>] 

= y Ot> + 3*1 +3>2 + 2 *J + J >4 + 3*J + 2> 6 +-■• 

+ 2 )V-3 + 3 J’,-2 + 3>’„_l + >*»)■ ( 54l > 

This rule, called Simpson's (3/B)-mle t is not so accurate as Simpson's rule, 
the dominant term in the error of this formula being -(3/SO) h 5 y iy (x). 


5.4.4 Boole's and Weddle’s Rules 

If we wish to retain differences up to those of the fourth order, we should 
integrate between x$ and x 4 and obtain Boole's formula 


JV * = ~<Jyo+n yi + ]2/ 2 + 32y 3 +7 y A \ (5.42) 

*a 


The leading term in the error of this formula can be shown to be 

945 r 
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If, on the other hand, we integrate between and jr 6 retaining differences 
up to those of the sixth order, we obtain Weddle's rule 

J>^=“(3b + ^ +y 2 + $yi + y A + 5y 5 + y«)- (5-43) 

the error in which is given by —(A 7 /l40)y vi (J). 

These two formulae can also be generalized as in the previous oases. 
It should, however, be noted that the number of strips will have to be a 
multiple of four in the case of Boole’s rule and a multiple of six for Weddle's 
rule. 


5.4.5 Use of Cubic Splines 

If j(x) is the cubic spline in the interval then we have 


j(jc) dx 


J 

*a w 1 

M JC,_1 

+“(*/ “ Wj-i j+|<* 


\dx, 


using (3-104). On carrying out the integration and simplifying, we obtain 

<5,44) 


r«l L 






where M ir the spline second-derivatives, are calculated from the recurrence 
relation 


M t-\ +4M, +m m - 2y, +>v+i)> <=i, x .... »-i. ( 3 . 1 09} 

h 

The use of the cubic spline method is demonstrated iu Example 5.12. 


5,4,5 Romberg Integration 

This method can often be used to improve the approximate results obtained 
by the finite-difference methods. Its application to the numerical evaluation 
of definite integrals, for example in the use of trapezoidal rule,, can be 
described* as follows. We consider the definite Integral 
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2D3 


I=jydx 

a 

and evaluate it by the trapezoidal rule (5.33) with two different subintervals 
of widths hi and ^ to obtain the approximate values f, and I 2 , respectively 
Then Eq. (5.38) gives the errors £, and E 2 as 

E I =-±(b-atfy"(T) ( 5 . 45 ) 

and 

< 5M > 

Since the term y"(E) in (5.46) is also the largest value of y"(x) f ft is reasonable 
to assume that the quantities y JI (x) and >"(*) are very nearly the same. We 
therefore have 

rA 

El f£ 

and hence 

Ei tj 
A 2 -* 2 ' 

Since E 2 - E : = / 2 - , this gi ves 

El = TT-jVl-V- (5 47 ) 

*2 -ftt 

We therefore obtain a new approximation / 3 defined by 

which, in general, would be closer to the actual value—provided that the 
errors decrease moaotonkally and are of the same sign. 

If we now set 

Eq. (5.48) can be written in the more convenient form 

(5 49) 
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where = 

/(!*) =/ 2 and = 

With this notation the following table can be formed 


/(ft) 



The computations can be stopped when two successive values are sufficiently 
dose to each other This method* due to L.F. Richardson, is called the 
deferred approach to the limit and (he systematic tabulation of this is called 
Romberg Integration. 

5.4.7 Newton-Colea Integration Formulae 

Let (he interpolation points, x ir be equally spaced, Le. let jtj =x jj+jft* 
i = 0, 1* 2* ..., n, and let (he end points of the interval of integration be 
placed such that 

, . b-a 

= a, x n —b^ h — 

n 

Then the definite integral 

b 

I=jydx ( 5 , 50 ) 

a 

is evaluated by an integration formula of the type 

/-o 
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where the coefficients C i are determined completely by die abscissae x t . 
Integration formulae of the type (5,51) are called Newton—Cotes closed 
Integration formulae. They are ‘dosed" since the end points a and h are the 
extreme abscissae In the formulae. It is easily seen that the integration 
formulae derived Eqs. (5.4?M5,50) are the simplest Newton-Cotes dosed 
formulae. 

On the other hand, formulae which do not employ the end points are 
called Newton-Cotes, open integration formulae. We give below the five 
simplest Newton-Cotes open integration formulae 

% l3 

(a) J ydx = 2hy l +—y'Xx\ (*&<*■<**) (5.52) 

*]• it 3iJ 

fb) J^ = y05+>i) + — /'(*)» (5,53) 

} Ak 14 , ■ 

y dx = —(2j^ - y* * 2yj) + — h i /'(x), (n <S < jt 4 ) (S.54> 

*0 

*S 

(d) J y& m |j(i ] y\ + y2 + n +1 W+^*V ¥ C*>. ix 0 <x< 

*0 

(5.55) 

** 

(«) J y<*=—(1 ■» - M }'2 + 26yj "My. + I lyj) + —A’y^tS), 

(x a <x<x i ). (5.56) 

A convenient method for determining the coefficients in the Newton-Cotes 
formulae is the method of undetermined coefficients. This is demonstrated 
in Example 5.13. 

Example 5*7 Find, from die following table, the area hounded by the 
curve and the x-axis from x • 7.47 to x - 7.52 


X 

/(*) 

X 

/w 

7.47 

1.93 

7,50 

2,01 

7,48 

1.95 

7,51 

2,03 

7.49 

1.98 

7,52 

2 M 
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We know that 


7,S2 


Area - I 

f{x)dx 

7 A 

7 

with h = 0.01, the trapezoidal rule (SJ2) gives 

Area = 2yi[i >93 + 2(1.95 +1.98 + 2.01 + 2.03) + 2.06] = 0.0996. 

Example 5*8 A solid of revolution is formed by rotating about the jc-asds 
the area between the .r-axis, the lines x = 0 and x - I, and a curve through the 
points with the following coordinates: 

X 

y 

0.00 

1.0000 

0.25 

0.9896 

0.50 

0,9589 

0.75 

0.9089 

1.00 

0.8415 

Estimate the volume of the solid formed, giving the answer to three decimal 
places. 

If V is the volume of the solid formed, then we know that 

] 

\M 

) 

Hence we need the values of y 2 and these are tabulated below, correct to 
four decimal places 

X 

/ 

0.00 

l.OOOQ 

0,25 

0.9793 

0.50 

0.9195 

0.75 

0,8261 

1.00 

0.7081 


With it = 0,25, Simpson’s rule gives 

V = ^2^2 [1.0000+4<0.9793 + 0.8261)+2(0,9195) + 0.7081] 


= 2.8192. 
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3 



coned to three decimal places. 

We solve this example by both the trapezoidal and Simpson's rules with 
ft = 0.5, 0,25 and 0.125 respectively. 

(D h - 0.5: The values of je and y are tabulated below; 


X 

y 

0.0 

1.0000 

0.5 

0.6667 

1.0 

0.5000 


(a) Trapezoidal rule gjves 

/ = J-[L0O00 + 2(0.6667) + 0.5] = D. 70835. 

4 

(b) Simpson’s rule gives 

/ = i [1.0000 + 4(0.6667) + 0.5] = 0.6945. 

6 

(ii) h — 0.25: The tabulated values of jr and y are given below: 


X 

y 

0.00 

1.0000 

0.25 

0,8000 

0.50 

0.6667 

0.75 

0.5714 

1.00 

0.5000 


(a) Trapezoidal rule gives 

/=-[h0+2(0.8000 + 0.6667 + 0.5714) + 0.5] = 0.6970. 

8 

(b) Simpson’s rule gives 

/ =—[1.0 + 4(0.8000 + 0.S714) + 2(0.6667) + O.S) = 0.6932. 


Presented By: http://www.ebooksuit.com 


Copyrighted material 



208 Chapter 5: Numerical Differentiation ium! Ihtegyaifen 

(iii) Finally, we take k - 0.125: The tabulated values of x and y are 


*_ y 


0 

1.0 

0.125 

0,8889 

0,250 

0*8000 

0375 

0,7273 

0.5 

0.6667 


X 

y 

0.625 

0.6154 

0.750 

0.5714 

0.875 

0*5333 

1*0 

0.5 


(a) Trapezoidal rule gives 

/ = ^ [1.0 + 2(0.8189 + 0.8000 + 0.7273 + 0.6667) 
+ 0,6154 + 0.5714 +0.5333)+ 0.5] 


- 0.6941, 


(b) Simpson's rule gives 


/ = —[L0 + 4(0.8889 + 0.7273 + 0.6154 + 0.5333) 
24 

+ 2(0.8000 + 0,6667 + 0,5714) + 0,5] 

= 0.6932, 


Hence the value of / may be taken to be equal to 0,693, correct to three decimal 
places. The exact value of / is log*2, which is equal to 0,693147.,, + This 
example demonstrates that, in general, Simpson’s rule yields more accurate 
results than the trapezoidal rale. 


Example SJ& Use Romberg's method to compute 

/= [— dx, 

J 1 + jf 

o 

correct to three decimal places. 

We take h = 0.5,0.25 and 0.125 successively and use the results obtained b 
the previous example. We therefore hive 

/(ft) = 0.70*4, /j'l ft j =0.6970, and /(iftj = 0.6941 

Hence, using (5,49), we obtain 


i\k\* 


h 


6970 + ~ (0.6970 - 0,7084) = 0.6932. 
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0.6941 + i- (0.6941 - 0.6970) = 0.693 l 

Finally* 

/ i K^h j = 0.6931 + (0.693! - 0.6932) = 0.6931. 

The table of values is therefore 


0.7084 

0.6932 

0.6970 

0.6931 


0.6931 

0.6941 



An obvious advantage of this method is that the accuracy of the computed 
value is known at each step. 

Example SJ1 Apply trapezoidal and Simpson’s rules to the integral 

J 

7 = ^]-x 2 dx 
0 

continually halving the interval h for better accuracy. 

Using 10,20, 30,40 and 50 subintervals successively, an electronic computer, 
with a nine decimal precision, produced the results given in Table below. 
The true value of the integral is ar/4 » 0J85198163. 


No. of subM&rvats 

TrapezokSel rufe 

ShripBOfi's's rule 

10 

0.776129682 

0.781 752 040 

20 

Q.7$2116 220 

■0.764 111 766 

30 

0.783610 789 

0.784 tm 434 

40 

0.784 236 934 

0.764 940 638 

SO 

0.764 567120 

0.785073 144 


Example SJ2 Evaluate 

/ = J sin jtx tk 
o 

using the cubic spline method. 

The exact value of / is 2 lx = 0*63661978. To make die calculations easier, 
we take it- 2, i.e. A = 0.5. In this case, the table of values of x and 
y - sin/rx is 
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x y 

0 0 

0.5 L0 

UP 0.0 

Using (3 JO#) with = M 2 = 0* we obtain M { = -12. Then formula (5.44) 
gives 

/ j(*, +^)-|“W 0 +w,) + ^O 1 + 

l 1 l 1 

= 1- K — + -— 

4 16 4 16 


5 

£ 


= 0.62500000; 

which shows that the absolute error in the natural spline solution is 0.01161978, 
It is easily verified that the Simpson's rule gives a value with an absolute 
error 0.03004689, which is more than the error in the spline solution. 

Example SJ3 Derive Simpson's 1/3-rule using the method of undetermined 
coefficients. 

We assume the formula 
h 

J ydx = a^y^ + & Q y 0 + o i y lt (■) 

-h 

where the coefficients l,<? 0 and U| have to be determined. For this* we 
assume that formula (i) is exact when y(x) Is 1 , x or jc 1 . Putting therefore 
y(.t) -\ t x and x? successively in (i), we obtain the relations 


and 


+ 

$ 

+ 

Ji 

T 

i 

B 

00 

-* 


h 


—«_l + a^ = I jc dx = 0 

if 

(iii) 

-A 


2. 

a_,*o i =-h. 

(iv) 


Solving (ii), (iii) and (iv) for u_ (5 and u h we obtain 

2 . 4 h 

= and {§=—- 
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Hence formula (i) takes the form 
h 


J y +4y 0 +y 1 )p 

which is the Simpson’s I/3-rule given in Section 5,4.2, 

5,5 EULEB-MACLAURIN FORMULA 

Consider the expansion of V{e x - 1} in ascending powers of x f obtained by 
writing the Maclaurin expansion of ^ and simplifying 


~=--“+^+V 5 + «s-« 5 +-. 

-I X 2 


(5.57) 


where 


%-D, ®|- 12 - 720, 


*5 = 


1 


30,240 

_ ^HD 


etc. 


In (5.57) t if we set x =* AD and use the relation E me (see Section 
3,3,4), we obtain the identity 


58) 


—— = -—i + BihD + B>h*D* + & h 5 0* +■ 

E -1 hD 2 3 ^ 

or equivalently 

fL ~A = -L(£ J, -i>- I(£ j ’-1)+ BjADC^-I) + +.» (5*55) 

J? — l AjD 2 

Operating this identity on y pT we obtain 

^rrft -*>ft -»«> -»ft+- 

fi — I nD 2 

= y* - yo)- j(y m * >h)+~ yi)+V 3 <>f- jO 




(5.59) 


It can be easily shown that the left-hand side denotes the sum >© + yi + >2 +' 
+ y„_i, whereas the term 


on the right side can be written as 


it’* 


■*o 


since 1/D can be interpreted as an integration operator. 
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Hence, Eq, (5,59) becomes 


J y *=1(34)+ 2 n + 2 »+- ■+2>«-i+y«)“Oi - yj) 


L* Jl£ 

^ W , w mi « 

720 ^* ^ 30,240 




(5.60) 


which is called the Eider-Madaurm's formula for integration. The first 
expression on the right-hand side of (5,60) denotes the approximate value 
of the integral obtained by using trapezoidal rule and the other expressions 
represent the successive corrections to this value. It should be noted that 
this formula may also be used to find the sum of a series of the form 
y® + Vi + >2 + ■■ + y B ■ The use of this formula is illustrated by the following 
examples. 


ExampU 5.14 Evaluate 


nil 


'=/ 


sin x dx 


using the Eukr-Madaurm’s formula. 

In this case, formula (5,60) simplifies to 


p L l ,4 

J 8injt<ix = -(y( l + 2}i 1 +2). 1 + -.+2y pl . 1 +y„)+—+— 


+ 


.a 

_$ _+... © 

30,240 


To evaluate the integral, we take 4, Then we obtain 

*/2 -2 * 

f sinxdx =-(0+2+0) + — + 

" 1 8 192 


0 


-+•• 


= * . V f »t* 

4 192 1,84,320 


192 1,84,320 

, approximately 


= 0.785398 + 0.051404 + 0.O00528 
- 0,837330, 


On the other hand with k = jt/ 8, we obtain 

%n 

f sin xdx = —[(0+ 2(0.382683) + .707117 +0.923879+1.000000) 
0 16 

-0.987119+0.012851+0,000033 
= 1.000003. 
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Example $.15 Use the Euler-Maclaurin formula to prove 


t 

In this case, rewrite Eq. (5.60) as 


2 n(n + \)(2ti + \) 


^yo+y\+yi+-+y*-i+\y*‘^ } 


10,240 

Here y(x) = x 2 : yXx) = 2x and l? = L 
Hence eq. (i) gives 




Sum = | x 2 dx + + ]) + ^(2n -2} 


* i (2n* + 3w 2 + ti) 
6 


n(n +1X2n +1) 
6 


§,« ADAPTIVE QUADRATURE METHODS 

We have so far considered integration formulae which use equally spaced 
abscissae. In practical problems, however, we often come across situations 
which require the use of different step-sizes while solving a problem. This 
would be so if the interval in question contains parts over which the function 
varies too rapidly or too slowly. For better accuracy and efficiency, it would 
be desirable to take a smaller size in parts of the interval over which the 
function variation is large. Similarly, it would be efficient to take larger step 
sizes over parts in which the function varies too slowly. A numerical integration 
procedure which adapts, automatically a suitable step-size to solve an Integration 
problem numerically is called adaptive quadrature method. We describe 
below an 'adaptive quadrature method" based on Simpson’s (l/3)-ru)e and 
this can easily be modified to the other integration formulae: 

Suppose that we wish to approximate the integral 

b 

/ = j yCOdbc (5.61) 
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to within an accuracy t > Ch Using Simpson's (I/3)-ruJe with h = {b-a)f 2, we 
obtain 

/ = J j-(i) etc«|^o) + 4 y£±A>' tV W). a <it < * 


=/c<a)-^^V«ix 


where 


/(^6> 


=|[>w +4 > ,£ 7 


+m. 


{5.62) 


(5.63) 


Now, we suMivide the interval and set = 4* Simpson's (1/3)-rule then 

gives 

b * f- . . . 


r = 


where 


, . 4 3a+ b * a + b A a + 3b ... 

y<a) + 4y— + 2y—~ +4y— * + y(fr} 

4 2 4 

A 4 (*-a> r iy f e . 


if , t ,, 3e + fe a + b 
: y{a)+4y-~+y-;— 
>1 4 2 , 


6 2 4 /w ! 180x16 1 


( a+b\ ,(a+b ^ (t-o)ft 4 jVyi , 

{ a ’—H~r'Ti^ y ®* x 

{ a+b\ M ... 3a+b a+bl 

l fl — +y "r] 


(5.-64) 


(5.65a) 


Assuming 


s + 6 AT a+b . &+3b , L .l ,, 

~2 _ ’*J = 6 J ' _ 2“ +4,, ~4~ + ^ (5Mb 
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Eqs. (5-62) and (5,64) give on simplification 


+ 

o- 

r (a + b 

ft,—- - 


l 2 J 

\ 2 } 


Substituting (5.66) in (5.64), we obtain an estimate for the error, vk. 



^•‘1 

j 12/ 

a 

l 2 \ 


15 




If we suppose 


15 




<e 


and that 


{ 5 , 61 } 


(5.68) 


for some e >0 in the interval [a, H then Eq. (5.67) means that 

It 


(5,69) 


+ (5.70) 


to within an accuracy of f>0. 

If the inequality (5-68) is not satisfied, then the procedure is applied to 
each of the intervals [a,{a+fi)/2] and [(a + b)f2 t b] with the tolerance 
e/2, If the inequality is satisfied in both the intervals, then the sum of the 
two approximations will give an approximation to the given integral- If the 
test fails in any of the intervals, then that particular interval is subdivided 
in to ‘two sub intervals 1 and the above procedure is applied with a tolerance 
which is half of the previous tolerance- The following example demonstrates 
the testing procedure. 

j Example 5, f 6 Test the error estimate given by (5.67) in the evaluation of the 
integral 

xf2 

! - J COS X dx. 

0 
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Let h = it/4. Then 


Also 


and 


Hence 


0, -1 = —f 1 ++ ol = 1 .00228. 
\ 2) 12f Jl J 

4 ) 24 


, , ^ l 

1+4cos i + 7? 


/* *1_»f i 

'U’LTmU 


-p.+4cos— + 0 

S 


1 ^0, 2 j +1 |£, £ j = £-|| + + 4cos i + 4 cos Y j = 1.00013. 


ft follows that 


sK'D-'HMfi) 


=“ ( 0 . 00215 ) = 0 . 00014 , 


It can be verified that the 
nil 

i 

Actual error 




=o.oqqb* 


which is less than that obtained above. 


5.7 GAUSSIAN INTEGRATION 

We consider the numerical evaluation of the integral 

b 

/= J/(*)*&. ( 5 - 71 > 

a 

In the preceding sections, we derived some integration formulae which 
require values of the function at equally-spaced points of the interval. Gauss 
derived a formula which uses the same number of function values but with 
different spacing and gives better accuracy. 

Gauss'formula is expressed in the form 

] ji 

J F(«) I *i = »^<in) + ir 2 J'te)+ - + ir n F(t( 1 ,)-^ W,F(U,l (5.72) 

-I '=■ 

where the W t and u t are called the weights and abscissae, respectively. An 
advantage of this formula is that the "abscissae and weights 4 are symmetrical 
with respect to the middle point of the interval 
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21 f 


As an example, when n=l we solve i^(a} = 0, i.e, 

1 

2 

which gives the two abscissae: 


|(3a 1 -l}=0. 


^=-7f=-T " d “ l= 7? 


1 _£ 
y ' 


The corresponding weights are given by 

l 


r,- ri=s.*—L 

j, Mo~lf| W&-H| 


ll 


■“M|M 


= 1 


J-l 


and 


k- 

“ 1 ”*% 


1 

V 

M(-K0 

2 


=1 


j-l 


Similarly, for n = 3 we solve f*(a) = 0 That is, 

l (35 “ 

which gives the four abscissae; 


1 (35w 4 - 30 h 2 + 3) = 0. 
8 


u, = ± 


\S±lfx T 

35 


The weights W t can then be found from {5 ,82), It should be noted, however, 
that the abscissae a J - and the weights W t are extensively tabulated for different 
values of n. We list below, in Table 5.1, the abscissae and weights for 
values of n up to n = 6. 


Table 5,1 Abscissae and Weights for Gaussian Integration 


J 1 

tUf 

Hfl 

2 

0,57735 02692 

1.0 

3 

0.0 

0.66688 36669 


077450 66602 

0.6665555566 

4 

0.33996 10436 

0.66214 51649 


0.96113 63116 

0.34785 40451 

5 

0.0 

0.56888 86089 


0.53846 93101 

0.4768286705 


0.90617 964 S 9 

0,2369266651 

0 

0.23061 91861 

0.46791 39346 


0:66120 93365 

0,36076 15730 


0.93246 95142 

0.1713244924 
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which is singular at t = x. The principal value, /*(/)» of the integral is defined 
by 


P(f) = lim 
£-►0 



Md! 


(a c i <. £} 


= !{/% for if < a or t>b. 


(5,85) 


Setting x = (3 + uk and in (5,84), we obtain 

P(I) = P \ /(a + uh> du. 

• u-k 

Replacing f(a + uh) by Newton's forward difference formula. Table 3,1 (p.66) 
(see Section 3.6) at x - a and simplifying, we have 


/(/)= 

J =0 Jm 


where the constants Cj are given by 


J iu-k 


(5,86) 


<5.87) 


In (5.87), (*r) 0 -1, (ti), =w, (tf)j - iffa-l), etc. Various approximate formulae 
can be obtained by truncating the series on the right side of (5.86). Thus, by 
writing (5,86) in the form 



aVM 

/I 


(5.88) 


we obtain rules of orders 1 T 2, 3,,., etc., by setting n - 1.2 + 3,... respectively, 
(a) Two-point rule, n- 1: 


wt-± 


V/M 


i-0 


»c c /(fl) + C|A /(£?) (5.89) 

“ (Co - C\)f(a) + Cif(a+h% 
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(b) Three-point rule, n = 2: 
2 


W )= z mn Cj 

/*o J* 

- <*/(«) + C\& /(*) + c 2 A 2 f(o) 

= ^c 0 -q + ^c 3 j/(o) + Cq - c 2 )/(a + h) + + 2h}, (5,90) 

In the above relations, the values of cj are given by 


Go * tog* 


£z* 

* 


q - p + cek 
2 

c 2 =£- + p{k-]) + c$k(k -1), 

Hb 


(5.91) 


A discussion of errors in these formulae may be found in the paper by 
Delves [ 1968]. 

5.8*2 Generalized Quadrature 

In evaluating singular integrals which arise in practical applications, it will 
often be convenient to develop special integration formulae. 

We consider, for instance, the numerical quadrature of integrals of the 
form 

b 

/(*>• f/»#(/-«)<*. (5.92) 

a 

where /(f) is continuous but $(u) may have an integrable singularity, e g. 
log]j-/| or for cr>-1. For the numerical integration, we divide 

the range ( 0 , I?) such that ij = a + jh(j = 0,1, 2, n), with b = a + nh r 

Then (5,92) can be written as 


B-l '/« 

/«=£ j mt0-s)dl. (5.93) 

/■O 

The method to be followed here b to approximate fir) in (5.93) by the 
linear interpolating function f n (t), where 

-WjM-tjWjH* (5-94) 
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Substituting / n (t) for /(r) in (5,93). we obtain 
■ 

iu )=~X j iifj-H-»u~t;)fUj.,)m~s)dt. 

h J-0 ,, 

Setting f -ti + ph. this becomes 

*-i i 

/<*) = * 2) j «1- p)f(tj) + pfd M )]4>(tj +ph-s)dp. 
o 

which can be written as 

u-i 

«*>=*£ l<*<>„)]. (5.95) 

j-e 


ctj = h j {l-p)4>(fj + ph-t)dp (5.96a) 

0 

and 

i 

(5 96b) 

o 

It is dear from (5.96a) and (5.96b) that if d(it) = 1, then - fij - ht 2, and 
hence Eq, (5.95) gives 

/€»>=| [/(%) + 2/(0 + 2/(/ 2 ) + ■•+■ 2/(r_) + /(f„E 

which is the trapezoidal rule deduced in Section 5.4.1. Hence the rule defined 
by (5 95 ) t (5.96s) and (5.96b) is called the generalized trapezoidal rule and 
is due to Atkinson [1967]. When #{w) = log| u J, this rule Finds important 
applications in the numerical solution of certain singular integral equations. 1 In 
practice, the computation of the weights a i and ft] may be difficult, but 
they can be evaluated once and for all, for a given #(«)« 

In a similar way, one can deduce the generalized Simpson s rule— 
analogous to the ordinary Simpson's rule—by approximating/(f) by means 
of a quadratic in the interval tyr* tj+i)- 1 

The error in generalized quadrature can also be estimated by the method 
outlined in Section 5,4,1. For example, it can be shown that the error in the 
generalized trapezoidal rule is of order h\ assuming that f* is continuous 
in Ic, 6J. 


1. See, for example, Sastry [1973; 1976]. 

2. See, Noble [1964], p. 241, 
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5,9 NUMERICAL CALCULATION OF FOURIER INTEGRALS 


We consider, in this section the problem of computing definite integrals 
which involve oscillatory functions, Le. integrals of the form 

4=1 /(i)C Oscoxdx (5,97) 

a 

and 


b 

I t = J /(xjsin «»x<£r> (5,91) 

a 

Sueli integrals, called the Fourier integrals , occur in practical applications, 
e.g. spectral analysis , We describe below three methods for the numerical 
integration of such integrals and compare their accuracies through a numerical 
example. Only the outlines of the methods will be indicated here. For details, 
the reader is referred to the research papers cited. 

For definiteness, we outline the methods with reference to the particular example 


"J 


I - \ e x cos mx dx - - 


1 +m 


2 * 


(5.99) 


but these methods also hold good fbr equations of the type (5.98). In all the 
formulae below, a step-length h is used. 


5,9.1 Trapezoidal Rule 

Using this rule, the integral in (5.99} approximates to 



/riqht 
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which gives on simplification 

/ ^ sinh h 

2 cosh h - cos mh 

Formula (5.100) is due to Eirtarssoti [1972]. 


(5JOO) 


5.9.2 Fllorfs Formula 


in his original paper, Filon [1928] derived formulae for integrals of the type 
(5.97) and (5.98). In his method, the interval [a, 6] is divided into 2N 
subintervals and in each double interval f{x) is approximated by a quadratic. 
Thus this rule is similar to Simpson's rule except that there is an extra 
factor cos mx in the present case. Since the derivation of the formula is 
quite involved, only the relevant details are given below. 

With h = (b-a)K2N). let 


and 


C, =- f(a) cos ma + f (a + 2h) cos cy(a + 2h) 


+ /(a + 46)cosiu(fl+4>i) + -*+| f(b)to$&b (5.101) 


C 2 = f(a + h} cos ®{a + h) + f{a + 3h) cos m (a + 3h) + ■ ■ 

+ f(b-h)ca${o{b-h), (5.102) 


Then, 

b 

| f{x) cos mx dx - h (a [/(£>) sin mb -f(a) sin wo\ + fiC x + (?C 2 }, (5,103) 

a 

where 


a t* 

0 = 
S - 


m 2 h 2 + mh sin mh cos mh - 2 sin"(£t>/i) 

“ “^V 

2 {ai h El + cos J (a^r)] - sin 2afh) 

#V 

4 (sin mh - mh cos coh) 

■ 


A similar formula for the integral (5.98) is given by 


(5.104) 


b 

| /(x)sin(ujdt = /i{-£r [f(b)cmmh-f{a)cosma] +fiS { + <?S 2 } f (5.105) 

is 
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while Si and S 2 are sums similar to C\ and Cj for/{ jc) sin ©x. 
For the integral in (3$9) } the Filon formula is given by 


’(i 


/ v I 7 = h I p | - + e lh cos 2&>h + cos 4 &h + - - 


+ q(e * cos * h + e ^ cos 


<5, SOS) 


where 


and 


p = 2 


t + cos 3 fe>A) 

6>h 2 


sin lotfh 

4»W 


q = 4 


sin ©A 

®v 


cos mA^ 

© 2 * 2 y 


(5.107a) 


(5,107b) 


For computational purposes, however, the right side of (5,106) can be put 
into a more convenient form (see Einarsson [1972]). We have 


1 + e 2 * cos 2mb + e* h cos 4©A + 

2 


i + ^ COS 2(&rtk 

B= I 



€ -lnh € imnh 


\_ 

2 


Re £ e (-i+f«)J"* 

n= 1 


= 2 + R * 

t sinh 2 h 

2 cosh 2h - cos 2&h * 


on simplification. 

In a similar manner, we obtain 


e h cos mh^e cos 3mh + ■ ■ = 


sinh h - cos ©A 
cosh 2 h - cos 2 mh 
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sinh 2 h 


sinh ft. cos qjH 


2 cosh 2h - cos 2mh 
ft sinh ft 


cosh 2h - cos 2mk 


cosh 2h - cos 2coh 
(p cosh k + q cos oft). 


(5.1 OS) 


where p and q are given by (5.107). 

5.9.3 The Cubic Spline Method 

We first consider the integral (5.97) and let the interval [a, 6] be divided into 
n equal subintervals* each of which is of length h = (6 - a)iru Let f{x t ) ■= y /t 
i = 0, l,...i ft. If six) is the cubic spline interpolating to the data values (**, 
then we have 


where the M t [= )] satisfy the recurrence relation 


x t -x 
ft 


(5.109) 


+ AM t + Af i+l =—j CV/-i + > J+ ]) + ? = 1 , 2 ,,( 5110 ) 

h 

Hence we have 

b b 

l c = J /(jc) cos cox dx* J s(x) cos mx dx, 
a a 

A, 

Since s(r)ec [a, 6], we can integrate the above integral three times and 
obtain 


[ , -i t 

, .smarc f p, .sin©* , 

r(x>— - ~fj(*)-fir 

® J ® 


= — [j(b)siniMy - j(a)sina<y]+-i r [co$6(a f ( d )l 

<& & £ 

b 

- —-=■ [j"(b)sin6n? -j”(£i}sin am) + -Ar f sinewcfc. (5.111) 
<y m J 
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Similarly, applying Simpson's rule to the integral 


we obtain 


yjp *+i 

/ = I J f(*>>*}■& 

yj-i *-i 


231 




| [/(Xf_jt>)+4/(^ l y)+/(j| 4 | > jp ))dy 

>>L 

=— IA*m« ty-i) +4 /(vi>>P+/(Vh»i) 


+ 4 t/(Wy-i) +4 /(Wj) 4 V{W/tf)) 

+ /(*<+■ p^-i)+ 4/(x i+ , ,y y ) + /(x M p ^ y+1 )] 


= + f{~ij+\ ±ft+ ij-i + /mj+i 

+ Mfaj + A /-1 + 4 * + Au)+K/yJ (5il9) 

A numerical example is given below, 
ifjcctrtj/j/e J,/| Evaluate 

i ] 

/= J J e*+r<bdy, 

0 0 

using the trapezoidal and Simpson's rules, With h-k-Q.S, we have the 
following table of values of e I+y , 


y _0_ 0.5 LQ 

0 1 1.6487 2.7183 

0.5 1.6487 2,7183 4.4817 

1.0 2.7183 4.4817 7.3891 

Using the 'trapezoidal rule' (5.117} repeatedly, we obtain 

/ = — [1,0 + 4 (L6487) + 6(2.7183} + 4 (4,4817) + 7,3 8911 
4 

_ 13-30S0 
4 

= 3.0762. 


Copyrighted m 


Presented By: http://www.ebooksuit.com 



232 


Chapter 5: Numerical Differentiation and Integration 


Using 'Simpson’s iule* (5.119) repeatedly we obtain 
0 25 

/ = [| _0 + 2.7183 + 7.3891 + 2.7183 

9 

+ 4(1.6487 + 4.4SI7 + 4.4817 +1.6487) +16(3,71 S3)] 

26.59042 

9 


= 2,9545* 

The ‘exact value of the double integral is 2.9525’ and therefore it can 
be verified that the result given by Simpson's rule is about sixty times more 
accurate than that given by the trapezoidal rute. 


EXERCISES 

5.1. Find ^<J 0 ) at x^o,! from the following table: 


X 

W 

0,0 

LOOOO 

03 

0.9975 

0.2 

0.9900 

03 

0.9776 

0,4 

0.9604 


5X Hie following table gives the angular displacements Q (radians at 
different intervals of time f (seconds) 


6 

i 

0 

t 

0.052 

0 

0,327 

0,08 

0.105 

0,02 

0 408 

fUQ 

0.168 

0,04 

0,489 

032 

0.242 

0.06 




Calculate the angular velocity at the instant i — 0-06. 

5.3. From the following values of x and y, find dy/dx when x - 6: 


X 

y 

X 

y 

4.5 

9,69 

6.5 

2637 

5.0 

12.90 

7.0 

3234 

53 

16.71 

7.5 

39.15 

6,0 

2138 
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5.4. A rod is rotating in a plane. The following table gives the angle Q 
(radians) through which the rod has turned for various values of 
the time t in seconds. Find the angular velocity of the rod when 
/ = 0 . 6 , 


JC y 

X 

y 

0 0 

0.8 

2.022 

0.2 0.122 

1.0 

3.200 

0.4 0.493 

0,6 1.123 

1.2 

4.666 

The following table of values of x and y is given: 

* y 

X 

y 

0 6.9897 

4 

8.4510 

f 7.4036 

3 

8.7506 

2 7.7815 

3 8,1291 

6 

9,0309 

Find dyfdx when (i) x~], (n) jc^ 
when x=3. 

= 3, and(iii) j 

: = 6. Also find d 2 yfdx 2 

A function y = f(x) is defined as follows: 


jc y = /(x) 

X 

>'=/M 

1.0 1.0 

1.20 

L095 

1.05 1.025 

1.25 

1.118 

1.10 1.049 

1.30 

1.140 

US 1.072 



Compute the values of dyfdx and <Pyfdx* at x = 1.05. 

Tabulate the function/(x)=5* 4 -3xVlOx-6 at xq=- 0,50, x, =1.00 
and x 2 = 2.00, Compute its first and second derivatives as accurately 
as possible. Compare your results with the true values. 

The distances travelled by a rocket at different times are as given 
below; 

t s 

t 

s 

0 0 

4 

38 

1 3 

2 7 

3 15 

5 

50 


Estimate the rocket's velocity and acceleration for each value of t. 
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5.9* A cubic function y = /(r) satisfies the following data; 

J fix) 



0 

1 


1 

4 


3 

40 


4 

85 


Determine the function/(jr) and 

hence find f% 2) and /"(2). 

5 JO. 

The temperature T of a cooling body drops at a rate which is 


proportional to the difference 

T-T t where T f is the constant 


temperature of the surrounding medium. A metal ball which is initially 
at 150°C is dropped into water that is held at constant temperature 
T t - 40° C. The temperature of the ball at time r is given as follows: 


/(in min.) 

T (in D C) 


0 

150 


5 

74.8 


10 

68,5 


15 

50.7 


20 

44.4 


Determine dT/di at each value of r. If dTidt = -k{T-T s ), estimate 
the value of k by linear least squares. 

5.11. 

The function y - 3*e _Jt is tabulated below: 


X 

y 


3 

0.4481 


3.2 

03913 


5 

0.1010 


Develop a subprogram to find the first derivative values of y T test 
it with the above data and compare your results with the actual 


values. 


5,12, 

Prom the following table of values of x and y, Find dytdx at x = 2 


using the cubic spline method. 


X 

y 

2 

n 

3 

49 

4 

123 
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5.13. From the following table of values of jc and determine the value 
of dyidx at each of the points by fitting a cubic spline through them. 


* 

1 

2 

4 

5 


Z 

1 

3 

4 

2 


5.14. If y = A + Bx + Cx* and y$ t yy, are the values of y corresponding 
to x = £j f a + h, a+ 2ft respectively, prove that 
a+2h ^ 

J yt^ = -(j0+4y, +£j). 


5.15. Evaluate 

m 

(a) 1 t sin t ill 
0 


m 


i 


( 

5 + 2 / 


dir 


using the trapezoidal rule. 

5.16. Discuss a method for finding an approximate area under a given 
curve. A curve is given by the points of the table given below: 


X 

y 

X 

y 

0 

23 

2.5 

16 

0.5 

19 

3.0 

19 

1,0 

14 

3,5 

20 

1,5 

11 

4.0 

20 

2.0 

12.5 




Estimate the area bounded by the curve, the x-axis and the extreme 
cudi nates. 

5.17. Estimate the value of the integral 


3 



by Simpson’s rule, with 4 strips and 8 strips* respectively. Determine 
the error by direct integration, 

5.IS. Evaluate 

jr/2 

J Js\n& d& T 

o 

Using Simpson's rale with h-TzIll. 
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5.19. Find the value of 

7 

| X* log x dx 
3 

by taking 4 strips, 

5.20, The velocities of a car (running on a straight road) at intervals of 
2 minutes are given below 


5,21. 


5.22. 


Time (in min.) 

Velocity (in km/ hr) 

0 

0 

2 

22 

4 

30 

6 

27 

8 

38 

10 

7 

12 

0 

Apply Simpson's rule to find the distance covered by the car. 

Compute the values of 


l 

/- r 

dx 

j 

0 

1+JC 2 

by using the trapezoidal rule with A = 0.5, 0.25 and 0.125. Then 
obtain a better estimate by using Romberg’s method. Compare vour 
result with the true value. 

A reservoir discharging through sluices at a depth h below the water 
surface has a surface area A for various values of h as given below. 


h (in ft) 

A (in sq.ft) 

10 

950 

11 

1070 

12 

1200 

13 

1350 

14 

1530 


If i denotes the time In minutes, the rate of fall of the surface is 
given by 

dx A v 
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Estimate the time taken for the water level to fall from H ft to 10 ft 
above the sluices, 

5,23, Find the approximate value of 

mtl 

| ^COS0 d& 

a 

by dividing the interval into six parts, 

5J4, Evaluate 

i 

| cos j tic 
0 

using h = 0.2, 

5.25, Determine the maximum error in evaluating the integral 

*n 

J casxdx 

o 

by both the trapezoidal and Simpson's rules using four sub-intervals, 

5.26. Estimate the value of 




5.27* Derive Simpson's (3/8)-mle 


1 

*0 

Using this rule, evaluate 


3 

ydx = "/t(yp + 3yi+3yi+^>. 


r = f — dx 

J l + x 


with h = 1/6. Evaluate the integral by using Simpson's (l/3)-rale 
and compare the results. 

5.28. Deduce Weddle's rale 




1 + + ^ +6 ^ + ^ + s > / 5 + 

XQ 

and use it to obtain an approximate value of n from the formula 


f-ly* 

4 l 1 + j 2 
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5.36. Use the three-point Gauss-Legendre formula to evaluate the integral 


sin x dx. 


Compare this result with that obtained by Simpson's rule using 
seven points. 

5.37. Use the method of undetermined coefficients to derive the formula 


| f(x) sin j <£c = /(0) -/(2*). 


5.38. Apply Fi Ion's formula to obtain the value of 


J Eog(1 + u)sin Hindu. 


5.39. Using Filon's method, evaluate the integral 


| e f si 


sin \Qt dr. 


Compare your result with the analytical solution given by 

101 


5-40. If / = J* /4 cos 2 * dx, compute 

'Hi '(”■!)• '(f-f 

5.41. Verify the error estimate (5.67) for problem 40. 

5.42. Use adaptive quadrature to evaluate the integral 

2.0 

J sin — dx 
uia x 

to within ait accuracy £ = 0.001. 

5*43. Evaluate the following double integral 


jl 


by using Simpson's (l/3)-ruk. 
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Matrices occur in a variety of problems of interest; for example, in the 
solution of linear algebraic systems, solution of ordinary and partial differential 
equations, and eigenvalue problems. The matrix notation is convenient and 
powerful in expressing basic relationships in fields like elasticity and electrical 
engineering. In this chapter* we introduce the matrices independently although 
they can be treated, more conveniently, through the theory of linear 
transformations. We assume that the reader is familiar with the concept of 
a determinant and its properties and we describe briefly some simple properties 
of matrices which will be used in the solution of linear algebraic systems 
to which some considerable attention will be given in the later sections. The 
eigenvalue problem will be discussed in Section 6,5, whereas Section 6.6 
will be devoted to a discussion of the singular value decomposition of 
matrices. The theorems will be stated without proof. 

6.2 BASIC DEFINITIONS 

A matrix is an array of mn elements arranged in m rows and n columns. 
Such a matrix A is usually denoted by 


% 

a n 

<*\n 



°21 

a 22 

- a 2» 


(6.1) 

a ml 

a m2 

^ mn . 




im 
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where a Ut a n , ... are tailed its elements and may be either real or complex. 
The matrix A is said to be of size (m x ri), 

if m - n, the matrix is said to be a square matrix of order n. Thus, 

*11 hz ^3 

B - hi && 

hi &33 

is a square matrix of order 3. We may also have single-raw or single-column 
matrices. These are called vecrorr. Thus, fd|i*£|£, Og 3> ...*&| n ) is a single* 
row matrix or a row vector , and 


is a single-column matrix or a column vector . 

The elements a it in a square matrix form the principal diagonal (or 
mam diagonal). Their sum fJj | + &21 *- + a m is called the trace of A. If al 
the elements of a square matrix are zero, then the matrix Is said to be a null 
matrix. Thus* if a^ = 0 for Uj = l, 2 ,,.a* then A is a null matrix of order n. 
On the other hand* if only the elements on the main diagonal are nonzero* 
then the matrix is said to he a diagonal matrix. For example, 

Ij2 0 0 

C- 0 3 0 

0 0 4 

is a diagonal matrix. 

In particular, the diagonal matrix 

1 0 0 

0 1 0 

0 O 1 

in which all of the diagonal elements are equal to one* is called a unit matrix 
of order 3. Unit matrices are usually denoted by /, 

A square matrix is said to be an upper-triangular matrix if = 0 for 
I > J t and a lower-triangular matrix if a s j - 0 for f < J. For example* 

2 3 4' 

A= 0 5 6 

Q 0 7 
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is an upper-triangular matrix, and 

2 0 0 

B= 3 4 0 

5 6 7 

is a lower-triangular matrix. Matrices of the type 


A^ 


are called tridiagonal matrices. A square matrix A in which a s j = is said 
to be symmetric, if a^ = -aj it it is said to be skew-symmetric. For example, 

\2 5 61 


'*11 

*12 

0 

0 

*21 

a n 

*23 

0 

0 



*34 

0 

0 

*43 

* 44 - 


A = 


is a ‘symmetric matrix/ and 




5 

6 

0 

-2 

-3 


8 

7 

2 

0 

—4 


is a ‘skew-symmetric matrix.’ 

Every square matrix A is associated with a number called its determinant, 
which is written as 



*ri 

*12 


*1jh 

Ml = 

*21 

*22 

h M 

*2* 


*ni 

a n2 

■** 

*nm 


The minor My of the element of ]A \ is that determinant of order (n- 1} 
obtained by deleting the row and column containing Op. The cofactor Ay of 
Qy is given by 


4 =(,-lf J M r 


( 6 . 2 ) 


If | ^[ 5*0, then .4 is said to be a nonsittgular matrix; otherwise, it is said to 
be singular. Thus, 

l 2 0 

A= 3 4 0 

5 6 0_ 

is singular since \A\ = 0. 
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6.2.1 Matrix Operations 

Equality of two matrices Two matrices are said to be equal if they are 
of the same size and if their corresponding elements are equal. 

Addition and subtraction of matrices Two matrices of the same size can 
be added or subtracted by adding or subtracting their corresponding elements. 
Thus, if 



Multiplication of a matrix by a scalar IF 

*n a n a \i 
A= <*2I *22 *23 

*31 *32 *33 

then 

'*»ii ton to| 3 

kA * ton toji tou 

to^| to^ torjj 

where k is scalar. 

The following properties of matrices easily fallow from the definitions : 
(i) j< + (fl + C)«(,4 + fl)+C 
(ii> A+B=B+A 

(iii> k(A+B) = kA + kB^ k being a scalar. 

(iv> (ij +k 2 )A = k l A + k 2 A, *j and k^ being scalars. 

Multiplication of a matrix by another matrix Two matrices A and B can 
be multiplied only if the number of columns of A is equal to the number 
of rows of B . Thus, if A and B are of sizes (2x1) and (3x2), respectively, 
then their product C t given by 

€ = AB, 

is defined, and will be of size (2x2). The elements of C are obtained by the 
rule that the element C^ of C is equal to the sum of the products of the 
corresponding elements of the ith row of A by those of the /th column of 
B. In general, if A is of size (ixm) and B is of size (wxn), i.e. if 
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We find that 



0 

-2 

~3 


0 

2 

3 

A' = \ 

2 

0 

-5 

= - 

-2 

0 

5 


3 

5 

0 


-3 

-5 

0 


It should be noted that this is a "skew-symmetric matrix . 1 


Example 6*4 Express the- matrix 

I 7 
A - 


S' 


6 2 9 
5 4 3 

as the "sum of a symmetric 1 and a ‘skew-symmetric matrix,' 
In general,, we can write A as 

, A + A 1 . A-A' „ n 
A = --+-sC+A say. 


Now 


g, _ A + A r A*+A _ ^ 


2 2 

which shows that C is a symmetric matrix. Again, 

^ _A*-A^ A-A'_ D 

2 2 2 * 
which shows that D is skew-symmetric. 

For the example given above, we have 


A' = 


1 6 5 

7 2 4 

8 9 3 


Hence 


A + A H 


1 

6,5 2 

6,5 6,5 


6.5 6,5 

6,5 


, which is a symmetric matrix. 


and 


A-A 1 


0 0.5 

-0.5 0 

-1.5 -2.5 


1.5 

2.5 
0 


, which is a skew-symmetric matrix. 


The reader may verify that their sum Is equal to A itself. 
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§.2.3 The inverse of a Matrix 


Let A be a nonsinguiar square matrix of order n. Let 5 be another square 
matrix of the same order such that 


BA-1, 

where / is the unit matrix of order it. Then B is said to be the inverse of 
A which is written as A~ l so that 


AA~ l =A-'A = L (6,4) 

The following ten properties can be shown to hold on the inverse of a 
square matrix: 

(i) A~ l exists if and only if | A\ * 0. If f A\ = 0, A is said to be a singular 
matrix. 


(ii) If A 1 exists, it is unique. 

(iii) [f A’' exists, |jT 1 |»Mr 1 =l/|'<l|. 

(iv) {A-'y^A. 

(v) {AT 1 = Wy. 

(vi) (AS)' 1 -ar'A"'. 

(vii) if A is a diagonal matrix with diagonal elements a,„ then A~ ] is also 
a diagonal matrix with diagonal elements l/n rf . For example, if 


then 



0 

a n 

0 


0 

0 


A~' = 


0 

0 


0 

1/^22 

0 


0 

0 


(viii) / 1 = /. 

(ix) The inverse of an upper-triangular matrix is also an upper-tri angular 
matrix. For example, if 




2 

0 

0 


3 4 

5 6 

0 7 


then 


A- 1 


± 

70 


'35 

0 

0 


“21 

-2 

14 

-12 

0 

10 
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Similarly, the inverse of a lower-triangular matrix is also a lower- 
triangular matrix. 

(x) The inverse A'\ when it exists, can he computed, as follows 

Ai Ai 

,_i l Ai Ai 

A “Mi : : 

A ln A ln 

where are the cofactors of dn, in the determinant 

of the transpose A' of A, The matrix on the right side of (6.5) is 
called the adjoint of A, This is not an efficient method for the 
computation of the inverse. A better method is the ‘Gaussian elimination 
method 5 (fee Section 6.3.2). 

For a nonsquare matrix also, it is possible to define an inverse, called 
the generalized inverse. However, in this book, we shall consider inverses 
for square matrices only (see Section 6.6). 

Example 6.5 Find the inverse of the matrix 

"5 -2 4 

.4= -2 I I. 

4 10 

We have [A] = -37, and 

'5 -2 4" 

A* = -2 1 I - A. 

4 1 0 

Hence 

-I 4 -6" 

4 -16 -13 . 

-6 ^13 1 

The reader should verify that AA _1 =J, 

6,2,4 Hank of a Matrix 

Consider a square matrix of order n. Of the n rows and n columns, if there 
are at least k rows and k columns which must be deleted in order to obtain 
a non vanishing determinant, then the order of the highest ordered non vanish ing 
determinant in A is given by r = n-k 9 and this number is defined as the 
rank of A and is written r{A). Hence, the rank of a matrix is equal to the 
order of the highest ordered nonvanishing determinant in A. It follows, 
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therefore, that for a nonsingular square matrix of o-rder a, the rank is equal 
to rt. To determine the rank of a matrix, we have to find the order of the 
highest ordered non vanishing determinant. This method, although general, 
would be tedious when applied to matrices of higher order, for which the 
‘Gaussian elimination method, + to be described in Section 6.3,2, would be 
particularly suitable. 


Example 6.6 

(a) A = 

(b) A = 

(c> A = 

(d) A = 

(e) aJ 


0 

0 

2 

4 

2 

4 

I 

4 

3 

1 

4 
3 


0‘ 

0 / 


1 

2 

2 

5 

2 

2 

5 

2 


r(A} = 0, since all the elements are zero. 

r(A) - 2 t since |^[^0. 

\A\ =0; hence r(A) = 1. 


3 

6 

1 

3’ 

a 

1 


|^|~0; and 


2 

5 


*0; hence r{A}~ 2* 


hence r(.4) = 3. 


6.2.5 Consistency of a Linear System of Equations 

Consider the system of m Linear equations in n unknowns: 

*n*i+Si2*2 + -+a Xn x n =bi 

ai\X\ + 

a mi x \ +a ml x l + - ‘ +a mr x * “ V , 

The matrix 



Oil 

a i2 

... 



021 

on 

... 

02 rr 



a *2 

,,, 

a mn 


is called the coefficient matrix, and the matrix defined by 


( 6 . 6 ) 
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<^1 


i 

S’ 

(A, *) = 

<hi 

a 22 

«2*&1 


_ a m\ 

a m2 

a w«b m _ 


is called the augmented matrix. If r(A) is the rank of A and H.A » b } that of 
Mr b) then the fo]lowing theorem is proved in books on linear algebra (for 
example, see W.L. Ferrari Algebra)* 

Theorem 6.3 Jf r(A}<r(A, b% then the equations defined by (6.6) are 
inconsistent and there will be no solution; if r{A)- r(A f b), the equations 
are consistent and there exists at least one solution to the system (6,6), 


Emmpte 6J Examine for consistency the equations 


2*-3y+5i = l 
3jt 4 y - r = 2 


We have 


x+4y-6z = 1, 


Then 


Further 


A = 


2 

3 

i 


-3 

1 

4 


5 

-1 

~6 


Mi-o. 




hence r(A)-2. 


{A by* 


2 

3 

1 


-3 5 

i -i 
4 -6 


1 

2 
1 


and it can be seen that all determinants of the third order formed from 
(A t b ) are zero and that r(A T 6) = 2. It follows, therefore, that the equations 
are consistent. 

Example 6.8 Find whether the following system is consistent 

x-4y + 5z = 8 
3jc + 7y - r = 3 
jc 4 !5y-1 Is - ——14. 
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nu < 6I2 > 

||*il. = max |*|. < 6,3 > 

The norm ||*|| 2 is called the Euclidean norm since it is just the formula for 
distance in the three-dimensional Euclidean space. The norm M® is called 
the maximum noun or the uniform norm. 

It is easy to show that the three norms ||x|| lt || jt[,[> and Ijljjrt satisfy 
the conditions (62) to (6-9), given above. Conditions (6.7) and (6.8) are 
trivially satisfied. Only condition (6.9), the triangle inequality, needs to be 
shown to be true. For the norm ||x|Jg we observe that 

ll*+Jll = 2>+*l 

f-t 

lot 

i =1 fa| 

-IUIi Hr Ih 

Similarly, for ||x||«, we toe 

Hx+ylL-mix |JS|^^| 

^max (IxJ+bJ) 

HlilL+!lylL< 

The proof for the Euclidean norm is left as an exercise to the reader. 

To define matrix norms, we consider two matrices A and B for which 
the operations A + JB and AB are defined. Then, 


\A + B\Z\A\ + \B\ 

(6.! 6) 

\AB\$\A\\B\ 

(6.17) 

^l^lallivfl (a a scalar). 

<6,18) 

From (6.17) it follows that 


\A f \S\Af, 

(6.19) 
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where p is a natural number. In the above equations, \A | denotes the matrix 
A with absolute values of the elements. 

By the norm of a matrix A = ]a 9 \ t we mean a nonnegative number, denoted 
by |[ A |[, which satisfies the following conditions 


|M||20 and 

|| A f| a 0 if and only if A = 0 

(6.20) 

\\aA\\=\a\U\\ 

(a a scalar) 

(6.21) 

m+jmmh+imii 


(6,22) 

\\AB ||£|MI| ||£||- 


(6.23) 


From (6,23)* it easily follows that 

M'll*lUir (6-24) 


where p is a natural number. 

Corresponding to the vector norms given in (6.11M6-13)* we have the 
three matrix norms 


Mil,-max £|a f | 
J i 


Mil. = 


L >J 


(the column normj 


(the Euclidean norm) 


(6.25) 

(6.26) 


|| A || „ = max ^ | ay | (die row norm), (6.27) 

f J 

Jn addition to the above, we have MIL defined by 

\\A = (Maximum eigenvalue of A 7 A) V2 . (6,28) 

The eigenvalues of a matrix will be discussed in Section 6,5, 

The choice of a particular norm is dependent mostly on practical 
considerations. The row-norm is, however, most widely used because it is 
easy to compute and, at the same time, provides a fairly adequate measure 
of the size of the matrix. 

The following example demonstrates toe computation of some of these 
norms. 


Example &9 


Given the matrix 


A 



find Milt.MIL and MIU 


2 3 

5 6 

8 9 
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This method is obviously unsuitable for solving large systems, since the 
computation of A~ l by cofhctors will then become exceedingly difficult, and 
one should therefore adopt methods which do not require the computation 
of the cofactors. We will describe such methods in the subsections below 
and these can be applied to my number of equations. 

6.3.2 Gauss Elimination 


This is the elementary elimination method and it reduces the system of 
equations to an equivalent upper-triangular system, which can be solved by 
back substitution. 

We consider the system given in (6,29), viz r , the system of rt linear 
equations in n unknowns 


<h 1*1 + a l2 x 2 + d l3*3 + ■ ■ ■ + a \» x n = h 
*l]X\ + <>12*2 + * 23*3 + —+ a 2n x n = h 


(6.29) 


a *i X l + ^ + ■“ + a nn** = ?>n 


There are two steps in the solution of the system (6,29), viz., die elimination 
of unknowns and back substitution. 

Step 1: The unknowns are eliminated to obtain an upper-triangular system. 
To eliminate x x from the second equation, we multiply the first equation 
by (-^ 2 |/flu) and obtain 


”*21*1 ^ a \l~ x 2 “*13 “^*3 -■ ■ ■“0 lrt — = -b[ —. 

°n % *n a n 

Adding the above equation to the second equation of (6,29), we obtain 

a n -G\i — U + foil "flu-^T 1 - 
«iiJ L ^it J l <hi) °u 

(6-32) 

which can be written as 

022*2 + * 23*3 +*" + 

where a' n =a n -^ {a^ x !a x ( ), etc. Thus the primes indicate that the original 
element has changed its value. Similarly, we can multiply the first equation 
by -ai\ia\\ and add it to the third equation of the system (6.29).This 
eliminates the unknown from the third equation of (6.29) and we obtain 

*h*2 + «35*3 + ■ + *3** n =%- t 6 - 33 ) 

In a similar fashion, we can eliminate x x from the remaining equations and 
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after eliminating x, from the last equation of (6*29), we obtain the system 
a,,*,+^ 2 i2+a| 3 xj+ •+=ij 
a h x 2+ a 23 x }+ - + a 2» x „=b2 

fl S 2*2 + °H*3 +,,+ ( 4 i*h =i 3 ( 6 - 3 ^) 

We next eliminate x 2 from the last (n-2) equations of (6.3 4). Before this, 
il is important to notice that in the process of obtaining the above system, 
we have multiplied the first row by (“a^/ay), he. we have divided it by ay 
which is therefore assumed to be nonzero. For this reason, the first equation 
in the system (6.34) is called the pivot equation> and a u is called the pivot 
or pivotal element. The method obviously fails if ay = 0* We shall discuss 
this important point after completing the description of die elimination method. 
Now, to eliminate x 2 from the third equation of (6.34), we multiply the 
second equation by and add it to the third equation. Repeating 

this process with the remaining equations, we obtain the system 


^1*1 + tf|2*2 + 013*3 +<'4’O ln X„ =b| 

d n x 2 +a%$X 3 + ■■■+aJ Jr x Jt = ££ 

+ ■"+*>» “If 


(6.35) 


^13*3 + ^ a m x n = 


In (6.35), the 'double points' indicate that the element have changed twice . It 
is easily seen that this procedure can be continued to eliminate x 3 from the 
fourth equation onwards, x 4 from the fifth equation onwards, etc*, till we 
finally obtain the upper-triangular form: 


a\ ft + 0,2*2 +^3% + " 1 + <»iiA = h 

<* 22*2 + +*" + s 2n x it ~ ^2 

<^3*3 + ' = ^ 


(6,36) 



An-t) 


where a^~ l) indicates that the element has changed (n- 1) times. We 
thus have completed the first step of elimination of unknowns and reduction 
to the upper-triangular form. 

Step 2: We now have to obtain the required solution from the system 
(6.36). From the last equation of this system, we obtain 
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This is then substituted in the (rt-l)di equation to obtain and the 
process is repeated to compute the other unluiowns, We have therefore first 
computed then **_], . in that order. Due to this reason, the 

process is called bock substitution. 

We now come to the important case of the pivot being zero or very 
close to zero. If the pivot jj zero, the entire process fails and if it is close 
to zero, round-off errors may occur. These problems can be avoided by 
adopting a procedure called pivoting. If a T | is either zero or very small 
compared to the other coefficients of the equation, then we find the largest 
available coefficient in (he columns below die pivot equation and then interchange 
the two rows. In this way, we obtain a new pivot equation with a nonzero 
pivot. Such a process is called partial pivoting,, since in this case we search 
only the columns below for the largest element. If, on the other hand, we 
search both columns and rows for the largest element, the procedure is 
called complete pivoting. Jt is obvious that complete pivoting involves more 
complexity in computations since interchange of columns means change of 
'order" of unknowns which invariably requires more programming effort, 
[n comparison, partial pivoting, i.e. row interchanges, is easily adopted in 
programming. Due to this reason, complete pivoting is rarely used. 

Example 6. If Use Gauss elimination to solve 

2.r + v 4 z * iO 

3x + 2y + 3z = 11 
jc +4y + 9z = 16. 

We first eliminate x from the second and third equations. For this we 
multiply the first equation by (-3/2) and add to the second to get 

y+3z = 6, (i) 

Similarly, we multiply the first equation by (-1/2) and add it to the third to get 

7y + l7z = 22, <ii) 

We thus have eliminated x from the second and third equations. Next, we 
have to eliminate y from (i) and (it). For This we multiply (i) by “7 and add 
to (ii). This gives 

-4z = -20 Or z = 5. 

The upper-triangular form is therefore given by 

2x + y + z = 10 
y + 3z = 6 
z - 5. 
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It follows that the required solution is x = y = -9 and z = 5. 

The next example demonstrates the necessity of pivoting in the elimination 
method. 


Example 6*12 Solve the system 


O.GOQ2jc + 0.30Q3y = 0.1002 


2.QQQ0X + 3.0000y = 2.0000. 

The exact solution of the system is easily seen to be x = 1/2 and y = 1/3, 
We first solve the system without pivoting. Multiplying the first equation 
by (-“2/0.0002) and adding it to the second, we obtain 


[ 3J 


0000 - 


0.3003 k 2 
0.0002 


>■ 


20000 - 


0.1002x2 

0.0002 * 


which simplifies to 


im*Sy=m* 


Hence the triangular system is 


0.0002.1 + 0.3003y = 0.1002 
1498,5y = 499 

The solution to the system is given by y - 0.3330 and x = 0.5005; the errors 
in the solution being due to the large multiplier. 

We next interchange the two tows so that the system Is written as 


2.0000X + 3.000% - 2,0000 


0.0002*+ O,3O03y« 03002 

Multiplying the first equation by (-0.0002/2) and adding It to the second, 
we obtain 


0.3003 - 


3.0000 x 0.0002 ^ 


y = 0.1002- 


2x0.0002 


which simplifies to 
Hence file solution is 


0,3000j? = 03000. 



and 



6,3.3 Gauss-Jordan Method 


This is a modification of the Gauss elimination method; the essential difference 
being that when an unknown is eliminated, it is eliminated from all equations. 
The method does not require back substitution to obtain the solution and is 
best illustrated by the following example: 
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Example 6,14 We shall consider again the system given in Example 6.13. 
We have here 


Am 


The augmented system is 

T2 I 


2 

4 


1 

3 

9 


1 

2 
4 


After the first stage* this becomes 

"2 1 1 

0 1/2 3/2 

0 7/2 17/2 


i 

3 

9 


0 

I 

0 


1 
0 
D 

I 

- 3/2 

- 1/2 


0 

O 

1 


0 

1 

0 


0 

0 

1 


Finally* at the end of the second stage* the system becomes! 


2 1 L : 10 0 

0 1/2 3/2 ■ -3/2 1 0 

0 0 -2 ! 10 -7 1 

This is equivalent to the three systems: 

"2 i i = r 
0 1/2 3/2 i -3/2 L 

0 0-2 1 ID 

2 1 liO' 

0 1/2 3/2 i 1 

0 0 —2 \ —7 

and 

2 I 1:0' 

0 1/2 3/2 : 0 * 

0 0 - 2:1 


whose solution by back substitution yields the three columns of the matrix: 
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-3 

5/2 

- 1/2 

12 

- 17/2 

3/2 

-5 

7/2 

- 1/2 


which is the required inverse/* *. 

We can also find 

M|- 2 (ij(-2)—2 

by looking at the triangulated coefficient matrix. If this value is sero, then we 
cannot back substitute and the matrix has no inverse, 

6*3.5 Number of Arithmetic Operations 

Since the total execution time depends on the number of multiplications and 
divisions in Gaussian elimination, we give below a count of the total number 
of floating-point multiplications or divisions in this method. 

For eliminating xy* i,e. in Eq, (6.32), the factor o^/on “ s computed 
once. There are (it-i) multiplications in the (ra-1) terms on the left sick and 
l multiplication on the right side. Hence the number of 4 floating-point" 
multiplications/divisions required for eliminating xy is l+j*-l+l =n + l* 
Butxj is eliminated from (w-1) equations. Therefore, the total number of 
muJtiplications/divisions required to eliminate x t from (it -1) equations is 

{n — 1) (n +1) = (if -1) (n + 2 -1). 

Similarly* the total number of multiplications/divisions required to eliminate 
x 2 from {ft - 2) equations is 

{n - 2}n = (n “ 2) (» + 2 - 2). 

The total number of muitiplications/divisions required to eliminate x 3 from 
(it - 3) equations is 

3} (it -!) = («-3) (u + 2 - 3). 

Similarly* the total number of multipHcations/divisions required to eliminate 
Xp from {n-p) equations is 

{n-p){n + 2-p% 
and finally* is eliminated in 

In ™(n - 1)][*+2 - (n -1)] = L3, 

Summing up all the above, we can write the total number of arithmetic 
operations (Le* muitiplications/divisions) as 
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X ( B -/’)(' , +2-p> = £[(*-p) J + 2(»- J P)] 

P= I 

Jl-I 

- 2 (n 2 + p 2 - 2ftp + 2w - 2 p) 

P =l 


6 2 

+ 2 fczl>- 
2 

*T’ 

where we have used the formulae: 

, + 2 + 3 + .. +n = ^l and ]J + 2 I + 3 J + .. + » 3 =^±lH?2ia, 

2 6 

It follows that the total number of ‘floating-point’ multiplications or divisions 
in Gaussian elimination is w J /3. In a similar way,, it can be shown that the 
Gauss-Jordan method requires n 2 t2 arithmetic operations. Hence, Gauss 
elimination is preferred to Gauss-Jordan method while solving large systems 
of equations. 

6.3,6 LU Decomposition 

This method is based on the fact that a square matrix A can be factorized 
into the form LU, where L is unit tower triangular and U is upper triangular, 
if all the principal minors of A are nonsingular, i.e. if 



^11 

^2 


a u 

°u 

S I3 

o M *0, 

*o, 

a n 

a 22 

°23 

fl 21 

*22 



#31 

#32 



It is a standard result of linear algebra that such a factorization, when it 
exists, is unique. 

We consider, for definiteness, the linear system 

dll*! +a\2*2 +a a*$ -h 

# 21*1 + a 22*2 + # 23*3 “ ^2 

a 3l x l + a 3l*2 + fl *1 J 3 
which can be written in the form 

AX^B* (6J3) 
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Let 

where 


and 


A = W f 


L = 


1 

hi 

L f 3. 


0 

l 


h2 


0 

0 

i 



"ll 

»12 

«13 

£/- 

0 

*22 

“23 


_ 0 

0 

u n . 


(635) 


{6.40} 


(6.41) 


Hence (638) becomes 

LUX - B, 

(6.42) 

If we set 

ii 

Nj 

(6,43) 

then {6,42} may be written as 

LY = 5, 

(6,44) 

which is equivalent to the system 



y\ ~h 

hift + yi=h 

+ hiyi + y* = h 

and can therefore fee solved for y u yj, y% fey the forward substitution. When 
Y is known, the system (6.43) becomes 


&22 x 2 +u 23 x 3 "> 2 > 

“ 33*1 =y j, 

which can be solved for x it x 2 < jr 3 by the backward substitution. 

We shall now describe a scheme for computing the matrices L and [f, 
and illustrate the procedure with a matrix of order 3. From the relation 
(6.39), we obtain 


■ i 

0 

o ' 

"1! 

«12 

"13 " 



*IZ 

*12 ’ 

hx 

1 

0 

0 

"22 

"23 

= 

*21 

*22 

*22 

M 

hi 

I ^ 

0 

o 

“33 . 


3 i 


033 . 
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Multiplying the matrices on the left and equating the corresponding elements 
of both sides* we get 


*2l u ll=°2l* hl*ll +u 12 =°22- =°21 

fj|“l 1 =£ bh 4l% +hl u n = °32* 4l“L3 + 4a M 23 + w 33 = a 33 

Solving them, we get 


(6.45a) 


/ - a n. 
*21 m ~T' 
n \\ 

u 22 = <*n 

@\l 


I _ °3i. 

h\ ~ — > 

a i\ 


m 23 =s 23 ““^13 
^11 




(6.45b) 


from which wjj can be computed. 

We thus have a systematic procedure to evaluate the elements of L and 
U. First, we determine the first row of U and the first column of L; then 
we determine the second row of (/ and the second column of l, and finally* 
we compute the third row of U, The procedure can be obviously generalized. 

When the factorization is effected, the inverse of A can be computed 
from the formula 

A- i =(LU)-' i =ir'r'. (6.46) 


Example 6.1S Solve the equations 


2x+ly+z =9 
x + 2y + 3z - 6 


by LU decomposition. 
We have 


Let 


3r + y + 2z = 8 



3 

2 

1 


1 
3 

2 


! 1 

0 

o' 


*12 

*13 " 


'2 

3 

r 

hi 

1 

0 

0 

u n 


= 

1 

2 

3 

.hi 

hi 

i 

0 

0 

* 33 . 


3 

l 

2 




(ii) 
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Clearly, 

also 

and 


v n ^12 - 1* “la = 1; 


/n«ii = i so that / 2 | = - 


so that /ji=-r 

A 

For u 17 and u 2 ^ we have the equations 

t 2l v u + u u *2 and t 2i u n +u 23 = % 
from which we obtain 

w 22 - ^ u 23 = 2 1 

Finally, l i2 and are obtained front 

^l w 12 + hi u 22 “ 1 an< i hi u l$ + ^2 U 23 + U 3S = 2, 

and hence 

^2 * -7 and «^ = 1&. 

It follows that 


A = 


and hence the given system of equations can be written as 


' 1 

0 

0 ’ 

'2 

3 

1 " 

i/2 

i 

0 

0 

1/2 

5/2 

3/2 

”7 

1 

0 

0 

18 


‘ 1 

0 

o’ 

"2 

3 

1 

jr 


¥ 

i/2 

1 

0 

0 

1/2 

5/2 

> 

= 

6 

3/2 

-7 

1 

0 

0 

18 _ 

i 


A 


or, as 


i 

0 

0’ 

'ft 


¥ 

1/2 

1 

0 

ft 


6 t 

3/2 

-7 

1 



a 


where 


2 

3 

1 

¥ ’ 


‘A ' 

0 

1/2 

5/2 

y 

£ 

yi 

0 

0 

18 

2 


.ft . 
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Solving the system in (v) by forward substitution, we get 

3 

With these values of yy y& y^ eq. (vi) can now be solved by the back 
substitution process and we obtain 

35 29 = J± 

X ~ ]*’ 1 IS 


6,3,7 LU Decomposition from Gauss Elimination 


We have seen that Gaussian elimination consists in reducing the coefficient 
matrix to an upper-triangular form. We show that the LU decomposition of 
the coefficient matrix can also be obtained from Gauss elimination. The 
upper-triangular form to which the coefficient matrix is reduced is actually 
the upper-triangular matrix U of the decomposition LU. Then, what is the 
lower-triangular matrix £? For this, we consider the system defined by 

AX*b, (6.47) 


where 



0H 

d\ 2 



*1 ' 


> ' 

A - 

fl ll 

a 22 

*23 

, X = 

*2 

, b - 



_ a JI 

a n 

fl 33 . 


_*3 _ 


a. 


To eliminate Xy from the second equation, we multiply the first equation by 
a^yfayy and subtract it from the second equation. We then obtain 


a 22~ a l2^ L 
a Y\) 


*i + 


a 13 -a^ 




or 


■bj ■ (6.4-8) 

The factor l 2 \ lS called the multiplier for eliminating from the second 

equation. Similarly, the multiplier for eliminating .V] from the third equation 
is given by / 3t =qjj/d] L . After this elimination, the system is of the form 


011*1+0,2*2+0,3*3 =*l 1 


dn*l + ^ 23*3 -*4 


(6.49) 


a h x Z + 0 33*3 = *$♦ 


In the final step, we have to eliminate x j from the third equation. For 
this we multiply the second equation by and subtract it from the 

third equation. We then obtain 
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273 


and 


”73 

78 

24 

92 

66 

25 

-80 

37 

10.01 


Example 6.18 The system 

lOi] + 7 j 2 + 8xj + 7 jc 4 = 32 

7*. + 5jt + fix, + 5 j* = 23 

1 1 3 (t) 

&* L +6x 2 +IOjt 3 +9x 4 =33 

7jc| + 5Jo + 9 jj + 10a' 4 =31 j 

is ill-conditioned since the system 

10*i + 7*2 + 8*3 + 7 * 4 =32.1 

7xj +5x2 6*3 + 5*4 “ 22.9 

8*j + 6*2 + 9x4 = 32.9 

7xj + Sx 2 + 9xj +1 Oxj = 31.1 

has the solution [6, —7.2, 2.9, -0.1] whereas the system ([) has the solution 

[M.Ml 

Ill-conditioning can usually be expected when | A |, in the system Al = b. is 
small. The quantity v(A) defined by 

K+HI/ 1 ! (6-65) 

where ||j 4|| is any matrix norm, gives a measure of the condition of the 
matrix . It is called the condition number of the matrix. Large condition 
numbers, as a rule, indicate ill-conditioning of a matrix. We give below 
examples of ill-conditioned and weil-conditioned matrices. 


Example 6.19 Let 



[2 1,01 J 

Taking the Euclidean norms, we obtain 

\\A\\ 0 =3.163 and M ] || # = 158.273. 
Hence v[A) - 500.974. It follows that A is ‘ill-conditioned.’ 


Example 6*20 Let 
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We have 

|| B || ( = 0.959 and II S“' II. = 2.6M. 

Hence 

v(B) = ||J?IUI«-‘|! f =2.555. 

It follows that B is a wel[-conditioned matrix. 

Another indicator of ill-conditioning Is the following. If A = (a^3 and 


s i ={a?\ + &a + ’ +a £)' 


\n 


(6,66) 


then the quantity 


k = - 


s, s 2 .. s h 


(6.67) 


indicates, in some sense, the smallness of the determinant of A, If k Is very 
small compared to 1, then the matrix A is 'ill-conditioned. 1 Otherwise, it is 
well-conditioned. For die matrix A in Example 6.19 above, we obtain \ A \ = 0.02, 
jr, = - 2.2360679 = 2.240 and k = 3.993 x lQ~ 3 . Similarly, for the matrix 

B in Example 6.20, we obtain [ B \ = -0*36, s\ = t]QJ2 = 0.848, s 2 — 0,447 and 
k = 0,950. 


6=3.11 Method for Ill-conditioned Matrices 

One method of improving the accuracy for an ill-conditioned system is by 
means of working all the calculations to more number of significant digits. 
But imiltNength arithmetic is time-consuming and therefore uneconomical. 
One possible alternative is to improve upon the accuracy of the approximate 
solution by an iterative procedure. This is described below. 

Let the system be 


filial+a !2 x 2 + 0, 3 jcj =6, 

&l \*1 + a 22 x 2 + = h. 

ff31*l + ^2*2 + a 31 X 5 =^, j 


( 6 , 68 ) 


Let i|,X 2 ,i 3 be an. approximate solution. Substituting these values on the 
left-hand side, we get new values of say, b il £^ t A*. Thus the new 

system is 


+ ^ 2 * 2 +^ 3*3 =&l 
&2l*l + a 22*2 + °23*3 “ 1 

+ a M-h 


(6.69) 
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Subtracting each equation in (6,69) from the corresponding equation in (6.68), 
we get 


<*11*1 +fl l2 e 2 +a l3 e J 

a lx €\ + a i2 f 2 +OJ 3^ = £* 2 * 6/70) 

+a 3! f 2 +a 33 e 3 = 

where ^ -jq and d, « j| — jj, We now solve the system (6.70) for ^e 2 
and €y Since e i = x s -x il , we obtain 

x^ei+xy mm 

which is a better approximation for x t . The procedure can be repeated to 
improve upon the accuracy. 


6.4 SOLUTION OF LINEAR SYSTEMS—ITERATIVE METHODS 


We have so far discussed some direct methods for the solution of simultaneous 
linear equations and we have seen that these methods yield die solution after 
an amount of computation that is known in advance. We shall now describe 
the iterative or indirect methods, which start from art approximation to the 
true solution and, if convergent, derive a sequence of closer approximations— 
fke cycle of computations being repeated till the required accuracy is obtained. 
This means that in a direct method the amount of computation is fixed, 
while in an iterative method the amount of computation depends on the 
accuracy required 

In general, one should prefer a direct method for the solution of a linear 
system, but in the case of matrices with a large number of zero elements, 
it wit) be advantageous to use iterative methods which preserve these elements. 

Let the system be given by 


“11*1 + *12*2 +a l3 J l + "■ + 

+ £122*2 + °23*3 + ■ + “fcl Jl n “ 
a Sl x i+ a S2 x 2+ a M x 3*'+ a Sn x tt=h 


(6.72) 


a*i*i + <*1,2*2 +°„3*3 + =K J 

in which the diagonal elements a it do not vanish. If this is not the ease* 
then the equations should be rearranged so that this condition is satisfied. 
Now, we rewrite the system (6,72) as 
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„ _ °12 r a l3 _ a \n „ 

*1--*2 *3 — x » 

°ii °ii a n °u 

^ i>l <*li a 13 ^_f2n ^ 

°22 ^2 ' fl 22 a 22 


*3 


J 3? r 


%3 ^ 




*33 


**2 


A. 

a ft 

*33 


*«= ——“-*1 - — x 2 - 

a™ ^ a, 




(fo?3) 


Suppose jcj 1 ^ ij; 1 * are any first approximations to the unknowns 

x 2l -i x n . Substituting in the right side of (6,73)* we find a system of 
second approximations 


J2) _ A, _ r ®_ r 0) 

*1 “ x 2 *# J 

a ll a u a {] 


j£2) = Jb_ _ ^ x [i) a 

a n a 72 1 fl 22 " 1 

^.Jt) °3* JO 

*3 “ „ x \ 


a i 3 *33 


*33 


.(2) _ K_ Q n\ (1)_ Vj _(1) 




{6.74} 


“fW “m 

Similarly, if xj^, Xj" 1 . jcJ* 5 are a system of wth approximations, then the 

next approximation is given by the formula 


_tu 

% 

II 

_^l2 Jn) _ Jb 
■*2 

a * 

*t \ 

*11 

*l| 

j** )_A. 
*2 ~~ 

X l 

i 

«22 

*22 

*22 

r («+n 

v(") _ , 

a jr,n-l J 

*m 

*nn 

1 „ ' 
a rm 


(6.75) 


If we write (6.73) in the matrix form 

X = BX + C 


(6.76) 
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then the iteration formula (6.75) may be written as 

X* n+l) = BX in) + C (* * 77) 

This method is due to Jacobi and is called the method of simultaneous 
displacements , It can be shown that a sufficient condition for the convergence 
of this method is that 

\\B\\<\. <6.7£) 

A simple modification in this method sometimes yields faster convergence 
and is described below: 

In the first equation of (633), we substitute the first approximation 
(jcf^p jrJ 1 *,.,.,into the right-hand side and denote the result as r| 2 \ 
In the second equation, we substitute (x[ ZJ , x^K ,..*» jr") and denote 

the result as x\ 2 \ In the third, we substitute (x{*\ x^ t .and 

call the result as x^\ In this manner, we complete the first stage of iteration 
and the entire process is repeated till the values of j^ t Jfcj,*.*, x„ are obtained 
to the accuracy required. It is clear, therefore, that this method uses an 
improved component as soon as it is available and it is called the method 
of successive displacements, or the GaussSeidel method. 

The Jacobi and Gauss-Seidel methods converge, for any choice of the 
first approximation x ^ (J -1,2, „n), if every equation of the system (6,73) 
satisfies the condition that the sum of the absolute values of the coefficients 
a^an is almost equal to, or in at least one equation less than unity, i.e. 
provided that 


I 


J-hJ+i 





(6.79) 


where the *<* sign should be valid in the case of H at least’ one equation. It 
can be shown that the GaussSeidel method converges twice as fast m the 
Jacobi method. The working of the methods is illustrated in the following 
example: 

Example 6.21 We consider the equations; 

IQjq - 2 x 2 - - *4 = 3 

-2j£T| + 10*2 — *3 — Jt* - 15 

-jq ~x 2 + 10*^ -2x 4 = 27 
-*1 - X 2 — 2*3 + 10^4 = “ 9 , 

To solve these equations by the iterative methods, we re-write them as 
follows: 

jq - 03 + 0.2*2 + 0. i * 3 + 0. l*^ 

* 2 = 1.5 + 0.2*, + 0. 1*3 + 0. 1*4 
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X3 = 2*7 + 0, l*i + Q.Lq + 0.2*4 

*4 = “ 0.9 + 0-1 *[ + 0 ( 1*2 + 0*2*3, 

It can be verified that these equations satisfy the condition given in (6.79). The 
results are given in Tables 6.1 and 6.2: 


Tobin 8.1 Gausa=S©ld@! Method 


n 


*2 


Xi 

1 

0A 

1.56 

2.886 

-0.1368 

2 

0.8669 

1.9523 

2.9566 

-0.0246 

3 

09B36 

1.9899 

2.9924 

-0,004.2 

4 

0.9968 

1,9982 

2.9987 

-00008 

5 

09994 

1.9997 

2.9998 

-0,0001 

6 

0.9999 

1.9999 

ao 

0.0 

7 

1.0 

20 

ao 

0.0 


Table 6.2 Jacobi's Method 


n 

*1 


4a 

X* 

1 

0.3 

1.5 

2.7 

-0.9 

2 

0.78 

1,74 

2.7 

-an 8 

3 

0,9 

1.906 

2.916 

-0,108 

4 

0.9624 

1,9608 

2,9592 

-0,03© 

5 

0.9846 

1.9848 

2.9861 

-00156 

6 

0,9939 

1,9838 

2.9938 

-0,006 

7 

0.9975 

1.9975 

2.9976 

-0,0025 

a 

0.9990 

1.9990 

2.9990 

-0.0010 

9 

09996 

1.9996 

2.9996 

-0.0004 

10 

0.9998 

1,9998 

2.9998 

-0,0002 

tl 

0.9999 

1.9999 

2.9999 

- 0.0001 

12 

1.0 

2,0 

3.0 

0.0 


From Tables 6.1 and 6.2, it is clear that twelve iterations are required by 
Jacobi's method to achieve the same accuracy as seven Gauss-Seidel iterations. 

6.5 THE EIGENVALUE PROBLEM 

Let A be a square matrix of order n with elements £ty, We wish to find a 
column vector X and a constant x such that 

AX-XX. (6 M) 
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The characteristic equation of this matrix is given by 


-2~ A 0 1=0, 


which gives ^ ~ -2, 4 = 4 and 4 = 6. The corresponding eigenvectors are 
obtained thus 


(i) \ = -2. Let the eigenvector be 

x \ = ^ * 


Hen we have: 

‘*il IV 

* *2 =-2 xi , 

.%J U. 

which gives the equations 

7jlj +r 3 =0 and x { + 7x 3 = 0 

The solution b jq - * 3 = © with x 2 arbitrary, In particular* we take x 2 =1 and 
the eigenvector is 


*1=1. 


m 4=4. 


X 2 = x 2 


as the eigenvector, the equations are 

x l + x 3 - 0 and ~gjc 2 = 0, 


from which we obtain 


jq b -* 3 and x 2 - 0, 


We choose, in particular, jq = 1//2 and x 3 = -1/-/! so that x ^ + x J = L 

The eigenvector chosen in this way is said be normalized. We therefore have 


* 2 = 0 
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from which we see that 




23 

1 

0 


and that an approximate eigenvalue is 3, 

Repeating the above procedure, we successively obtain 


" 2*1 


'2.2’ 


2 


2’ 


'2 

LI 

; 4 

U 

; 4.4 

1 

; 4 

1 

; 4 

1 

0 


0 


0 


0 


0 


It follows that the largest eigenvalue is 4 and the corresponding eigenvector is 

m 

i 

0 

@,5.1 Eigenvalues Of a Symmetric Tridiagonal Matrix 

Since symmetric matrices can be reduced to symmetric tridi agonal matrices, 
the determination of eigenvalues of a symmetric tridiagonal matrix is of 
particular interest Let 

0 


A = 


°n 

o 


*\2 

*21 

*23 


au 

*33 


(6J4) 


141 = 


- 0 . 


To obtain the eigenvalues of A u we form the determinant equation 

hi-* °a 0 

*12 *U~^ *23 

0 *23 *33 ~ & 

Suppose that the above equation is written in the form 
Expanding the determinant in terms of the third row, we obtain 




( 685 ) 


*l 

*12 

1 

~ a 23 

°I1 -A 

0 

*12 

*22 

*12 

*23 


* (r^l - A) -<323(011 - *23 

= (%-X)A«)-4W 

= 0 . 


( 6 . 86 ) 
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^1 ^2 
a ll a 22 **23 

aj 3 ^23 ^3 


(6.93) 


Householder's method consists in finding a real symmetric orthogonal matrix 
p [ such that 


W- 


°|] ^12 0 

oj 2 ^23 

L 0 <*33 “Slj 


(6,94) 


where the primes denote that the elements have changed. Householder suggested 
that P l should be of the form 

P^I-IW 1 , (6.95) 

where 

K-[0 V 2 vjJ T and V J V (b.96) 

It is easily verified that 


where 


Further, 


A = 


1 

0 

0 


0 O 

1 - 2v* -2v^vj 

-2v 2 v } 1 - 2v 3 


vf+vf =1, 


i|/| T - (/ - 2 W 7 )(I - 2 W T f 
= (I-2W J )(I~2W r ) 


(6.97) 


(6.98) 


^I-4W t +4FV t W t 

(6-99) 


We thus see that P i is both symmetric and orthogonal. By direct multiplication, 
we find that 


% 


AP\ = 


a \2 


% 


032(1-2^3)- 2023 * 2 ^ 
^ 23 (1”2v|)-2^ 3 v 2 V3 


-2^vjvj +ff l3 C!-2vf) 
“3^22^2^ + cJ^O - 2 V 3 1 ) 

+ ^ 3 ( 1 - 23 !) 
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and therefore 


I 0 0 

7^=0 I - 2v\ -2i^yj 

0 -2v^Vj 1-2^ 


ff ll ^12 0 _ ^ v 2 ) “ ^3 V 2 V 3 -2kJ) 

X 0|2 ^ 2 ( 1 - 2 v|)- 2 a 23 v^ - 2 d 22 V 2 Vj + 023 ( 1 -2v|) 

% a ll( ] - 2vf)- 2033 V 2 V 3 - 2 ^V 2 V 2 + o 33 (l - 2 v|) 

Comparing (6.100) with (6.94), we find that 


( 6 . 100 ) 


0 = —2o 12 ^V3 + 0^(1 - 2v|) 


where 

Also* 




=a n 

(6.101) 

F=a n^+^n- 

(6.102) 


o; 2 =o 12 (1-2v^)^20|3v 1 ^ 

= fl, 2 -2v2(ff |1 v 1 + o 13 ^) 

= o l2 -2rv 2 <6,103) 


using (6.10(2). From (6J01) and (6.103), it follows that 
Ml? - (au -2n^) s +(o,3 -Tnrf 

= ajj + 0(3 +4r ! (v^ + v|) -4^<»|2^ + 


= of 2 +flf 3l 

(6.104) 

using (6.9B) and (6.102). Hence, 


oj 2 = ^2 + a fi ~ % rv 2 - ^ - 

(6.105) 

We therefore have two equations, viz.. 


- 2rvy = 0 

(6,106) 

and 


012 “ 2-^2 =±^1 

(6.107) 
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^4 («■!») 

To complete the construction, we define the orthogonal matrix 

(6.1 IS) 

so that Ai = QR as required. The sequence {A ±} converges either to a triangular 
matrix with the eigenvalues of ^1 on its diagonal, or to a near-triangular matrix 
from which also the eigenvalues can be easily calculated. Since the sequence 
converges slowly, a technique, known as shifting, is used to accelerate the 
convergence. This technique will not be discussed here, and the interested 
reader may refer to advanced texts for this. 

6.6 SINGULAR VALUE DECOMPOSITION 

We have so far considered square matrices only and in Section 6.3.6 we obtained 
the LU decomposition of a square matrix. A somewhat similar decomposition 
is also possible of a rectangular matrix and this is called the singular value 
decomposition (SVD). The SYB is of great importance in matrix theory 
since it is useful in finding the generalized inverse of a singular matrix and 
has several image processing applications. 

Let A be an (i»x«) red matrix with m't n. Then the matrices A 1 A and 
AA t are non-negative, symmetric and have identical eigenvalues, say We 
can then obtain the n orthonorm alized eigenvectors, say of A r A such that 

If we assume y„ to be the n orthonorm alized eigenvectors of AA J , then we 
have 


^ T y, = ^y». 

(6,117) 

Then A can be decomposed into the form 


A=UDV J , 

(6,118) 

where 


U T U-r 7 y=rr r =I H 

(6.119) 

and 


D -diag (yT^i i/^***** ^Ki)- 

(6.120) 


The decomposition defined by (6.118) is called the singular value decomposition 
of A, The matrix V(n*n) consists of x„ which are the n ortho normalized 
eigenvectors of A 1 A. It follows then that the eigenvectors of AA 1 , he. y M are 
given by 





( 6 . 121 ) 
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\[fy 0 0 ... 0 

0 ffy 0 ... 0 

0 00 . 


( 6 . 122 ) 


where ffy t iffy, .. mi ffy are called the singular values of A and are 
such that 


0. (6.123) 

[f the rank of A is r < n* then 

= IX = 0. (6.124) 

It can be shown that the singular value decomposition of A is unique if the 
fy are distinct and (6J23) is satisfied. In case, A is a square matrix of 
order then the matrices U, D and V are also square matrices of die same 
size and the inverse of A can be trivially computed* since 

A- l -VD~ l U T (6.125) 

and 


D~ l * diag 


1.7^1" 7^a 



(6.126) 


If any of the ^"s are zero, then the matrix A is singular. Similarly, if the ^ 
are very small, then the matrix A is very nearly singular. Thus the singular* 
value decomposition of a matrix gives a clear indication whether the matrix 
is singular or very nearly singular. The following example demonstrates the 
method. 


Example 6.25 Obtain the singular-value decomposition of 


1 2*\ 


A = 


1 I 
I 3 


We have 




'ill' 

and A J A = 

3 6’ 

2 1 3 


6 14 


The eigenvalues of A J A are given by A, = 16.64 and fy = 0.36. For the corres¬ 
ponding eigenvectors, we have 
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which gives the system: 


The solution is given by 


Again, we have 


which gives the system 


jftHa 

3 xj + 6 x 2 - 16 . 64 x| 
tijq +14 je£ = 16,64^, 




0.4033 

0.0166 


p ‘IP 

fl =0.36 

v 

[6 14J |_j 


*2. 


The solution is 


3r, + 6x 2 = 0.36 x 3 
63^ + 14x2 

I" 0.91661 
* 2 = [-0.4033j 

We also have = 4.080 and =0.60. 

The eigenvectors of AA J can then be obtained from {6.121}: These are 
given by 


0.5480' 


0.1833 ' 

03235 

and 

03555 

0J727 


-0.4889 


The singular-value decomposition of A is then given by 
Q.5480 0-1833 

03235 03555 

0.7727 -0.4889 



1 2" 


A = 

1 1 

* 


1 3 



4.080 0 1 [0.4033 0.9166 

J 0 0.60J [o,9)66 -0.4033 


EXERCISES 


6.1+ Obtain AB t when 
A = 


—=1 

tv> 

tn 


'3 5" 

-l o 0 

and B- 

I 0 

2 3 4 


2 0 
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6,2, Compute A 2 t A 3 and A*, when 



6-1. Form AB and BA: 



2 

l 

2 


a -=l 

2 

1 ' 

A = 

1 

0 

0 

and B = 

2 

3 

4 


2 

0 

2 . 


l 

“2 

3 


6,4. Compute A 1 and check your result by direct multiplication with A , 
where 



6.5, Find the inverse in the following cases: 



‘2 4 3 


1 

6 4 

(a) 

0 1 1 

Cb) 

0 

2 3 


2 2 -l 


0 

I 2 

Compute the inverse of the matrix 




3 2 

4” 




2 1 

1 




1 3 

5 



and use the result to solve the system of equations: 

3x + 2y + 4s -7 

2x+y+l-7 
x + 3y + 5z- 2, 

6.7, Find whether the following systems are consistent, or not: 

(a) 2i-y+*-4 (b) 5jr-3y + ?j = 4 

3x-y + z^6 3.t + 26y + 2z -9 

4x-y + 2z**7 7x+2y + lOi * 5. 

~x+ y-x-9 

6.8, Show that the equations 

jq + Ixj - Jj = 3 

*1-*1+2*3=' 

2 .V| - 2 x 2 + 3 *3 - 2 

X|«J2+X 3 =-1 

tie consistent and solve them. 
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6*9. Use Gaussian elimination with partial pivoting to solve the system 

2x { +i 2 -*3 =-l 
*1 - 2x2 + 3*3 - 9 
Jjtj -x 2 +5*3 =14, 

Check your answer by substituting into the original equations, 

6.1®. Use Gauss-Jordan method to solve the system in Problem 9. 

6.11. Find the inverse of the matrix: 

'I -l 1' 

A= 1 -2 4 

! 2 2 

using Gauss elimination, 

6.12. Solve the system 

5x - 2y + z = 4 
7x + y-5z ^8 
3x + ly + 4r -10 

by (a) Gauss elimination (b) Gauss-Jordan method. In both the cases, 
check your answers by substituting them into the original equations. 

6.13. Decompose the matrix 

'5 -2 f 

A* 7 I -5 
3 7 4 

into the form LU and hence solve the system ^x = b where 
b = [4 $ 10J T . Determine also £" 3 and U" ] and hence find^ -1 . 

6.14. Develop a subprogram lit a language of your choice to sol ve a system 
of equations using Gauss elimination with partial pivoting. Test 
your subprogram using the system given in Problem 12. 

6.15. Develop a subprogram in a language of your Choice to decompose 
a matrix A into the form W using partial pivoting. Include the 
possibility of computing the inverse iso. Test your program with 
the matrix given in Problem 13, 

6.16. Solve the system of equations: 

2x - y = 0 

-x + 2y - z ■ 0 
-y+2z-u-Q 
-z + 2u = 1 

by the procedure described in Section 6.3.8. 
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<•) 

'i 6 r 

(b) 

' 2 V2l (C) 

-9 2 6’ 


] 2 0 


LV2 ij 

5 0-3 


0 0 3 



-16 4 11 


€.23* Determine the largest eigenvalue and the corresponding eigenvector 
of the matrices 


(■) 

'10 

-2 

f 

m 

" 1 

3 

-f 


-2 

10 

-2 


1 

2 

4 


1 

-2 

10 


-1 

4 

10 


6.24, Use the iterative method to find the largest eigenvalue and the 
corresponding eigenvector of the matrix 

2 1 -2 

6 2-4 

3 19 2 ' 

-4 2 1 



6.25. Reduce the following matrices to the tridiagonal form by Householder’s 
method 


1 

3 

4 

( b ) 

2 -1 - l " 

3 

[ 

2 


-1 2 -1 

4 

2 

1 


-1 -1 2 


6*26. Use the QR algorithm to find the eigenvalues of the matrix 


A a 


0 

1 

2 


l 4 

3 1 

1 0 


6.27. Compute the SVD of fee matrix 


A = 


1 

2 

l 


2 

i 

3 


6,28, Find the eigenvalues and the corresponding orthonormalized eigen- 
vectors of fee matrix A 1 A if 


A = 


20 

10 

5 


4 
14 

5 


Hence determine the SVD of A. 
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Numerical Solution of Ordinary 
Differential Equations 


7.1 INTH QDUCTtON 

Many problems in science and engineering can be reduced to the problem 
of solving differential equations satisfying certain given conditions. The 
analytical methods of solution, with which the reader is assumed to be 
familiar, can be applied to solve only a selected class of differential equations. 
Those equations which govern physical systems do not possess, in general 
closed-form solutions, and hence recourse must be made to numerical 
methods for solving such differential equations. 

To describe various numerical methods for the solution of ordinary 
differential equations, we consider the general first order differential equation 

a'*) 

ax 

with the initial condition, 

H*o) = T0 (7-lb) 

and illustrate the thedy with respect to this equation. The methods so 
developed can, in general, be applied to the solution of systems of first- 
order equations, and will yield the solution in one of the two forms: 

(i) A series for y in terms of powers of i. from which the value of 
y can be obtained by direct substitution. 

(ii) A set of tabulated values of x and y , 

The methods of Taylor and Picard belong to class (i), whereas those 
of Euler, Runge-Kutta, Adams-Bash forth, etc,, belong to class (ii). These 

m 
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latter methods are called step^by-step methods or marching methods because 
the values of y are computed by short steps ahead for equal intervals h of 
the Independent variable. In the methods of Euler and Runge-Kutta, the 
interval length h should be kept small and hence these methods can be 
applied for tabulating y over a limited range only. If, however, the function 
values are desired over a wider range, the methods due to Adams-Bashfbrth, 
Adams—Moulton, Milne, etc., may be used. These methods use fi nite-differenoes 
and require ‘starting values’ which are usually obtained by Taylor’s series 
or Runge-Kutta methods. 

It is well-known that a differential equation of the nth order will have 
n arbitrary constants in its general solution. In order to compute the numerical 
solution of such an equation, we therefore need n conditions. Problems in 
which all the initial conditions are specified at the initial point only are 
called initial value problems. For example, the problem defined by Eqs. (7.1) 
is an initial value problem. On the other hand, in problems involving second- 
and higher-order differential equations, we may prescribe the conditions at 
two or more points. Such problems are called boundary value problems. 
We shall first describe methods for solving initial value problems of the 
type (7.1), and at the end of the chapter we will outline methods for solving 
boundary value problems for second-order differential equations. 

7J SOLUTION BY TAYLOfTS SERIES 

We consider the differential equation 

/ = (7.1a) 

with the initial condition 

y(* a )-yc am 

If jp(jc) is the exact solution of (7.1), then the Taylor's series for y(x) around 
jr = x 0 is given by 

= ■ < 7i > 

If the values of are known, then (7.2) gives a power series fory. 

Using the formula for total derivatives, we can write 

where the suffixes denote partial derivatives with respect to the variable 
concerned. Similarly, we obtain 

/"“/"«/„ + fiyf + /(/* +f n f)+fylj* + fyfi 

- /„ +lffjy *f 3 f„ * ffy 

and other higher derivatives of y The method can easily be extended to 
simultaneous and higher-order differentia! equations. 
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Example 7J From the Taylor series foryfx), find y(0.1) correct to four 
decimal places ify(x) satisfies 

y' -x- y 2 and yfO) = l. 


The Taylor series for y(x) is given by 

# . . , x 2 „ JC 3 j 4 Iv Jf ! V 

The derivatives etc. are obtained thus: 


y<x)-r-/ 

= ~ 1 


n 

IS 

/'Xx) = -2xf'-2/ 1 

J«'—8 

/(*)«- tyr-wf 

yj=34 

y v (x) = -2 ysT-ty/”-^ 

y 0 v —186 


Using these values, the Taylor series becomes 
/w 2 3 12 



+ ■■■ 


To obtain the value of yfOJ) correct to four decimal places, it is found that 
the terms up to x 4 should be considered, and we have y(D.l) = 0,9138. 

Soppose that we wish to find the range of values of x for which the 
above series, truncated after the term containing x 4 , can be used to compute 
the values of y correct to four decimal places. We need only to write 


—x 3 ^0.00005 or jc £ 0,126, 

20 


Example 7.2 Given the differential equation 

y n -*y r -y -0 

with the conditions >-(0) = 1 and /(0) = 0, use Taylor's series method to 
determine the value of y(0.1). 

We have y(x)-1 and y(x) = Q when j = 0. The given differential 


equation is 

/Xx)~xy\x)+y{x) (i) 

Hence /(0)ay(0)=L Successive differentiation of (i) gives 

y’Xx) = xy”{x) + /(*) + y'(x) = xy’X 4 + 2y(x% (ii) 

/(*) = xy"\x) + y'Xx) + 2/ r (x) = *y"(*) + 3/'(*)> (iti) 

/(X) = xy iv (x) + /"(*) + 3/"(x) = xy" (x) + 4y"’(x). (*v) 

y ¥i (x) = *y y {x) + y m (x) + 4y iv (jr) = xy\x) + 5/ v (x\ (v) 
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and similarly for higher derivatives. Putting x = 0 in (ii) to (v), we obtain 
y"(0) = 2/(0) = 0, y iv (0) = 3y i (0) = X /(0) = 0 f y v '( 0) = 5. 

By Taylor’s series, we have 


yix) = KO) + rv'(0) +y/*(0) + j /"(0)+^y k (0) 

+ 4 /(o)+ 4 ^ (o)+ - 


Hence 


y(0.1)=l+ 


(0J> 2 t (0.1)* (0.1? 


24 


0) + 


720 


(5)+ ■ 


= 1 + 0.005 + 0.0000125* neglecting the last term 
- 1.0050125, correct to seven decimal places. 


7.3 PICARD'S METHOD OF SUCCESSIVE APPROXIMATIONS 

integrating the differential equation in (7.1), we obtain 

X 

y-^o+ J ffay)dx. 

Equation (7.3), in which the unknown function y appears under the integral 
sign, is called an integral equation. Such an equation can be solved by the 
method of successive approximations in which the first approximation to y 
is obtained by putting y<> for y on right side of (7J) S and we write 

X 

/ 1 )= yi>+ f f{x,y 0 )di 

XQ 

The integral on the right can now be solved and the resulting yis substituted 
for y in the integrand of (73) to obtain the second approximation y 2) : 

X 

)P ) -yo + J Ax./'^dx 

Proceeding in this way, we obtain y 3 \ and y^ f where 

x 

y {n) =yo+ J with > t0) = y 0 (7.4) 
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If we assume tlie continuity of dflify, then the expression in the brackets 
can be simplified by using the mean value theorem [see Theorem 1.5, 
Chapter l] 

/(■Sf Fit) ”/(^?)» M^i)) c [Fh " yfai)] fyt X Ri ^tt)f 

where £ n lies between and y n . We thus have obtained the recurrence 
formula 


^ji+J ” ^ he„fy{x nt |^) + i^+[ + 4j+| 


= e ff [l + V J ,(x J|t fc)l + ^ l iVh a 12) 

The first term on the right side of (7,12) is the propagated error. It. the 
error in y„ + ] resulting from the error in the previous approximation y H , 
Expressions for can be obtained by successive substitutions into 
(7 P 12), Thus we obtain 

- 0 , 

gj = + jL,* 

*!-[ !WA-4)]«+A)+^+4 

^ = [1 +¥^£ 2 >] {[1 +¥,£*,.£)] + A )+^+ 4 J +* 3+4 

and so on. 

An upper bound for die total solution error can be obtained analytically, 
but this will not be attempted here. The interested reader is referred to the 
book by Isaacson and Keller for more details. The step-by-step calculation 
of the solution error using relation (7.12) is demonstrated in the following 
illustrative example. 

Example 7.6 We consider, again, the differential equation y = -y with 
the condition ><0) = l, which we have solved by Euler's method in Example 7.5. 

Choosing b = 0.01, we have 

i+¥,(^,&)M+o.oi(-i)=o.99. 

and 

A»1 =~y/'Q>.)=^<M0Sy(p„), 

In this problem, fCAi^fC**)! since / is negative. Hence we successively 
obtain 


1^1 £0.00005 = 5k JO' 5 , 

|Zzl £(0.00005)(0 99)<5* 10“ 5 , 
fig! £(0 + O0CK)S) £0*9801) < 3 xLO'*, 
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and so on. For computing the total solution eiror, we need an estimate of 
the rounding error. If we neglect the rounding error, i.e. if we set 

^ + i=0, 

then using the above bounds, we obtain from (7,12) the estimates 
eo =0, 

kiUSxlQ -5 

je 2 |£0.99*i + 5x1(T 3 <l<r 4 

lejl* 0.99^2 + 5 x 10“ 5 < 1 + 5 x 10" s 

je^l S 0.99i?3 + 5 k 10 -5 < 10^* + lO^ 4 = 2 x J(T* = 0.0002 


It can be verified that the estimate for e 4 agrees with the actual error in the 
value of y{0,04) obtained in Example 7*5, 

7.4.2 Modified Euler’s Method 

Instead of approximating /{x, y) by /(xq. Vo ) in (7,6), we now approximate 
the integral in (7.6) by means of trapezoidal rule to obtain 

y\ = + J [/(Wa W(*i '^i)l (7-13) 

We thus obtain the iteration formula 

y[“ 11 -«,+|l/{^.^>+/(*i,j', ( " 1 )J. «=0,1, 2,... (7.14) 

where y\ n) is the nth approximation toyi- The iteration formula (7.14) can 
be started by choosing y[ 0 ^ front Euler’s formula: 

v} 0 ’ = >0 +¥ (xo,y a )- 

Example 7J Determine the value of y when x = 0.l given that 

j(0) = I and y = j 3 +y 

We take h =0,05, With j^=0 and > 0 - 1.0, we have /(j^ f v 0 }=LO, Hence 
Euler’s formula gives 

yj® -1 +0,05(1)= 1,05 

Further * 3 -0.05 and /(xj t yf <J> ) = 1.0525, The average of /(j^,j? 0 ) and 
f(*\i yf*0 la 1.0262. The value of y{ ]) can therefore be computed by using 
(7.14) and we obtain 

jf> = 10513. 
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Repeating the procedure, we obtain y ~J .0513, Hence we take y ( -1.0513, 
which is cotiect to four decimal places. 

Next, with jtj - 0.05, j\ =10513 and ft = 0,05, we continue the procedure 
to obtain y it i.e, the value of y when x = 0.1. The results are 

j4 0) = UW y^P = UG55* yf* =1.1055, 

Hence we conclude that the value ofy when x = 0.1 is 1,1055, 

7.5 HUNGE-KUTTA METHODS 

As already mentioned^ Euler's method is less efficient in practical problems 
since it requires ft to be small for obtaining reasonable accuracy. The Runge- 
Kutta methods are designed to give greater accuracy and they possess the 
advantage of requiring only the function values at some selected points on 
the sub interval. 

If we substitute yj = y 0 + ft/T*o» yo) on the right side of Eq. (?.□}, we 
obtain 

h 

yi =+j t/o+/(-*«+*. >o + '%)], 

where /q - /(jcq , y 0 ). If we now set 

*i = ft/o and k 2 = hf{x 0 + K >o + k \) 
then the above equation becomes 

a-is) 

which is the second-order Runge-Kutta formula. The error in this formula 
can be shown to be of order ft 3 by expanding both sides by Taylor's series. 
Thus, the left side gives 

yo++ ~y<l + ^r-yi"+ 

and on the right side 

A+*J^ + ¥o“ + 0(A 2 ) 

“Vo 

Since 

¥ f y_ 

dx Sc By 3 

we obtain 

t 2 = h [/i + hfi +0(A J )]-Vb +A J /j + 0(A 3 ), 
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where the parameters have to be determined by expanding both sides of the 
first equation of (7.18a) by Taylor’s series and securing agreement of terms 
up to and including those containing h*. The choice of the parameters is T 
again, arbitrary and we have therefore several fourth-order Rnnge-Kutta 
formulae. If, for example, we set 


<*0 = 00 =^* 



fh=Q 


1 



a 2 = l 


^“ 1+ R 7 

«-iK> 


am 


we obtain the method of Gill, whereas the choice 


i „ 1 i 

ao =«!=-■ fit =*i = 2 

fi\~fii~ v i = ®' <*i=8i=i • 

Wy = r 4 =i, 

6 o 


(7.20) 


leads to the fourth-order Runge-Kutta formula, the most commonly used 
one in practice: 

* =X> +^(*l +2*2 + 2*J t* 4 ) <7-21a> 

where 


*i = ¥(^>b) 

*a = ¥^iq + |*i>b + |*i 

h = ¥C*o + ^>to +h) 


(7.2 lb) 


in which the error is of order A 5 . Complete derivation of the formula is 
exceedingly complicated, and the interested reader is referred to the book 
by Levy and Baggot. We illustrate here the use of the fourth-order formula 
by means of examples* 
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We take h - 0,2. With jc^ = ^ =0, we obtain from (7.2 la) and (7.21b), 

= 0 . 2 , 

* 2 - 0.2 ( 1 . 01 ) = 0 . 202 , 

* 3 =0.2 (1 + 0.010201) = 0.20204, 
k A = 0.2 (1 + 0.040820) = 0.20816, 
and 

y{02) = 0 + - (Jt, + 2k 2 + 2Jt 3 + k 4 ) = 0.2027, 

6 

which is correct to four decimal places. 

To compute y(0<4}, we take ^ = 0,2, =0.2027 and h-Q.2, With 

these values (7.2la) and (7*2 lb) gives 

k, = 0.2 [1+ (0.2027)*] = 0.2082, 

*2 = 0.2 [1 + (0.306*) 2 ) = 0.21 *S, 

* 3 =0.2 [1 + (0.3121> 2 ] = 0,2195, 

* 4 =0.2 [I + (0.4222) 2 ] = 0^356, 

and 

^(0.4) = 0,2027 + 0,2201 = 0.4228, 
correct to four decimal places. 

Finally, taking = 0.4, > 0 = 0.4228 and h = 0,2, and proceeding as 
above, we obtain y(0,6) = 0.6841, 

Example ?.t& We consider the initial value problem y’=3x+y/2 with the 
condition y(G) = 1, 

The following table gives the values of y{0,2) by different methods, the 
exact value being L I6722193. It is seen that the fourth-order Runge-Kutta 
method gives the accurate value for h = 0*05. 


Method 

h 

Computed value 

Eutor 

02 

1.100 000 00 


0,1 

1.132 500 00 


0.05 

1.140 507 50 

Modified Euler 

02 

1.100 000 00 


0.1 

1.150 000 00 


0.05 

1,162 862 42 

Fourth-order RunginKutta 

02 

1.167 220 83 


01 

1.167 221 86 


0.05 

1.167 221 93 
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?.© PREDICTOH-CORRECTOR METHODS 

In the methods described so far, to solve a differential equation over a single 
interval, say from x = x n to x = x n+l „ we required information only at the 
beginning of the interval, i.e. at x = x rr Fredictor^orrector methods are the 
ones which require function values at i n3 T Ft _i ? T n _ 2l ,,. for the computation 
of the function value at x„ + \, A predictor formula is used to predict the 
value ofjj at x n+l and then a corrector formula is used to improve the value 
of y n+ i * 

In Section 7.6.1 we derive Predictor-corrector formulae which use 
backward differences and in Section 7,6.2 we describe Milne’s method 
which uses forward differences, 

7,6.1 Adams-Moulton Method 

Newton’s backward difference interpolation formula can be written as 

/(*,»=/„+»v/ 0 + »(»»'H»+av A + ... (7.22) 

2 o 

where 

h 

If this formula is substituted in 


>i=>t + 1 


f(x t y)dx. 




(7.23) 


we get 


)[ 


)\=yo+ I /o + + 


n(n 


-vV 0 


dx 


=y 0 *f> J[/»+"%+ +■■■]<* 

= ^j + ftfl + -V+—V 2 +=V J +—V 4 + --l/o- 
™ { 2 12 S 720 J 0 

It can be seen that the right side of the above relation depends only on y $, 
all of which are known, Hence this formula can be used to 
compute y x . We therefore write it as 

,r^ + (l + iv + lv^|v> + §V* + ...]/ 0 (7.24) 
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This is called Adams-Bmhforih formula and is used as a predictor formula 
(die superscript p indicating that it is a predicted value). 

A corrector formula can be derived in a similar manner by using Newton's 
backward difference formula at f: 

f(x,y)=A + n( ” + 1) vVi + gfe±Sfr±l> v 3 / 1 + ... (7.25) 

2 6 

Substituting (7.25) in (7.23), we obtain 


*=?»+ | +-]* 
= 2-° + ■* J [fl + »** + - -] dn 


^M+h\ t-Iy~ v 2 _l 
M [ 2 \2 24 


V 3 - 


ii 

720 




(7.26) 


The right side of (7.26) depends on yt f where for y\ we use y{\ 

the predicted value obtained from (7.24). The new value of/] thus obtained 
from (7.26) is called the corrected value, and hence we rewrite the formula as 

y' = W, + *fl-iv-—V 1 -—V 1 -—V 4 ----l/, p (7,27) 

,l ™ ^ 2 12 24 720 ) ' K 


This is called Adams-Moukon corrector formula the superscript c indicates 
that the value obtained is the corrected value and the superscript p on the 
right indicates that the predicted value of y { should be used for computing 
the value of /(xj,/,). 

In practice, however, it will be convenient to use formulae (7.24) and 
(7.27) by ignoring the higher-order differences and expressing the lower- 
order differences in terms of function values. Thus, by neglecting the fourth 
and higher-order differences, formulae (7.24) and (7,27) can be written as 

yf = v„ +■““ (55/ 0 -59/., + 37 /.J -9/_,) (7.28) 

and 

y\ =A +~<9/ 1 t ’4.]9/ 0 -5/_, +/_ j) (7.29) 

in which the errors are approximately 

and 
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and 


j£ + l = y n -1 + jOVl + 4 /» + /*+! > (7.34a) 

The application of this method is illustrated by the folio wing example. 

Example 7.12 We consider again the differential equation discussed in 
Examples 7,9 and 7*10, viz. t to solve / = i + y 2 with y(0)«0 and we wish 
to compute ><0.8} >>(1,0). 

With h - 0.2, the values of ><0.2), ><0,4) and ><0.6} are computed in 
Example 7.9 and these are given in the table below: 


X 

/ 

y-i + y 2 

Q 

0 

1.0 

0.2 

0.2027 

1,0411 

0.4 

0.4226 

1.17B7 

0.6 

0.6641 

1.4661 


To obtain ><0.8), we use (7.3 2) and obtain 

y (0.8) = 0 + y [2(1.0411) -1.1787 + 2(1,4681)] a 1.0239 


This gives 


/(0.8) = 2.0480. 


To correct this value of >>f0.S)p we use formula (734) and obtain 
y{0.$) = 0.4228 + ^ [IJ 787 + 4(1.4681} + 2.0480] = 1.0294. 


Proceeding similarly, we obtain y [1.0) = 1.5549, The accuracy in the values 
of ><0,8) and >< 1.0) can, of course, be improved by repeatedly using formula 
(7.34). 

Example 7.13 The differential equation y‘=x 2 +y 2 -2 satisfies the following 
data: 


X 

y 

0,1 

1.0900 

0 

10000 

ai 

O.B900 

0.2 

0.7606 


Use Milne's method to obtain the value of ><0.3}. 
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We first form the following table: 


X 

y 

* 2 + y 2 _ 2 

-at 

1.0900 

- 0,30190 

0 

1.0 

- 1.0 

0.1 

0.8900 

- 1 J 9790 

0,2 

07606 

- 1.30164 


Using (7,32), we obtain 

y{0.3) -1.09+ [2(-l)-(-1,19790) + 2(-l .38164)] = 0.614616. 

In order to apply (734), we need to compute y(GJ), We have 

y'(Q3) = (0.3) 2 + (0.614616) 2 - 2 = -1.532247. 

Now, (734) gives the corrected value of y(0J): 

y (03) = 0.89 + ^ J-l-197900 + 4(-l 38164) + (-L532247)] - 0.614776. 


73 THE CUBIC SPLINE METHOD 


The governing equations of a cubic spine have been discussed in demil in 
Section 3.14, where the cubic spline function has been obtained in terms of 
its second derivatives, M f . In certain applications, e.g. the solution of initial- 
value problems, it would be convenient to use the governing equations in 
terms of its first derivatives, Le. m y Using Herm lie's interpolation formula 
(see Section 3.93), it would not be difficult to derive the following formula for 
the cubic spline $(*) in £ j £ jq in terms of its first derivatives i'(jq) = m t : 


fr hr 


+ 1 


(jf< -xf [2(*-jq_|)+ A] (x- x^f [2{x, - x) + ft] 
A 3 * A 3 


where h - x ( -xj_|, Differentiating (7.35) with respect to x and simplifying, 
we obtain 


*'(*) = +*) -,)(*,-L +Ijt i ^3r) 

+ 60Vl>w) (I _ )( _ x) (7,36) 

h J 

Again, 

s'\x) = + 2 *t ~ 3 *)"TT( 2x (-I +x i ~ 3J ) 

hr ft 
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+ 60’r/H ) (^ 1+ ^-2 J( ), 

h* 

(7,37) 

which gives 


,f. * 2m,_i 4m, 6. . 

h h k 


2m^i 4mi 6 , 

(7.3*) 

If we now consider the initial-value problem 


x=/(*•*> 

etc 

(7.39a) 

and 


/(*i) = >b 

(739b) 


then from (7 r 39a), we obtain 

^jl = % + %L± 

dx 2 dx dy dx' 
or 

/'(*,)=fM* >:)+r y (x»yJXxi ■ n) 

= f x (x t1 Si ) + £(*„*) f(x t t s,). (7.40) 

Equating (7,38) and (7,4Q) f we obtain 

^ + IT~ % (i| - * M y= f * ix ‘ ’ S|)+ ^ (jr " s ‘ Wx <- Sl) (74l) 

from which can be computed. Substitution in (735) gives the required 
solution. 

The following example demonstrates the usefulness of the spline method. 
Example 7,,14 We consider apm the boundary-value problem defined by 

/-fe+5* J ' (0)=1, (i) 

whose exact solution is given by 

>-13e j/I -6jc-12 ffl 

We take, for simplicity* n-2. he, h =0.5 and compute the value of y(0,5). 
Here /(x* y) = 3x+ ytl and therefore we have f' x =3 and /J = 1/2. Also, 
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In a similar manner, one can extend the Taylor series method or Picard’s 
method to the system CM2). The extension of the Ruwge-Kutta method to 
a system of n equations is quite straightforward. 

We now consider the second-order differential equation 



(7.44a) 

with the initial conditions 


Md /(*o) = > r 0' 

(7.45 a) 

By setting z - y\ the problem (7.44a) and (7.45a) can 
problem of solving the system 

be reduced to the 

y' = z and z=F(x y y,z) 

(7.44b) 

with the conditions 


y(x o) = yo and z(*o) = ^ 

(7,45b) 


which can be solved by die method described above. Similarly, any higher- 
order differential equation, in which we can solve for the highest derivative, 
can be reduced to a system of first-order differential equations. 


7.9 SOME GENERAL REMARKS 

In the preceding sections, we have given a brief discussion of some well- 
known methods for the numerical solution of an ordinary differential equation 
satisfying certain given initial conditions. If the solution is required over a 
wider range, it is important to get the starting values as accurately as 
possible by one of the methods described. 

it is outside the scope of this book to present a comprehensive review 
of the different methods described in this text for the numerical solution of 
differential equations, but the following points are relevant to the methods 
discussed. 

The Taylor’s series method suffers from the serious disadvantage that 
all the higher derivatives of f(x t y ) (see Eqs. 7.1) must exist and that h 
should be small such that successive terms of the series diminish quite 
rapidly Likewise, in the modified Euler method, the value of h should be so 
small that one or two applications of the iteration formula (7.14) will give 
the final result for that value of A. The Picard method has probably little 
practical value because of the difficulty in performing the successive 
integrations. 

Although laborious, the Runge-Kutta method is the most widely used 
one since it gives reliable starting values and is particularly suitable when the 
computation of higher derivatives is complicated. When the starting values 
have been found, the computations for the rest of the interval can be 
continued by means of the predictor-corrector methods. 


Copyrighted mi 


Presented By: http://www.ebooksuit.com 



318 Chapter 7: Numerical Solution of Ordinary Differential Equations 


The cubic spline method is a one-step method and at the same time a 
global one. The step-siio can be changed during computations and* under 
certain conditions* gives Ofiif*) convergence. The method can also be extended 
to systems of ordinary differential equations. 


7.10 BOUNDARY-VALUE PROBLEMS 


Some simple examples of two-point linear boundary-value problems are: 


(a) /'{*) + /(*)/<*)+ g(*)y(x) = r(x) (7.46) 

with the boundary conditions 

y(jj) = o and j'(r„) = i (7.47) 

(b) (7.48) 
with 

and y(x„) = y\x n ) = B. (7.49) 


Problems of the type (b), which involve the fourth-order differential equation* 
are much involved and will not be discussed here. There exist many methods of 
solving second-order boundary-value problems of type (a). Of these, the finite 
difference method is a popular one and will be described in Section 7,10,1. 
An alternate method, called the shooting method, will be described next. 
Finally, in Section 7,10.3, we, discuss a method based on the application of 
cubic splines. 


7*10.1 finite-difference Method 


The finite-difference method for the solution of a two-point boundary value 
problem consists in replacing the derivatives occulting in the differential 
equation (and in the boundary conditions as well) by means of their finite- 
difference approximations and then solving die resulting linear system of 
equations by a standard procedure. 

To obtain die appropriate finite-difference approximations to die derivatives* 
we proceed as follows* 

Expanding y(x + ft) in Taylor's series* we have 

y{x + h) +^y"M+- (7S0) 

2 0 


from which we obtain 


Thus we have 


/(*) = 


>(x+ft)-y{x) 

h 



>W= j»W t O(*) 

h 


(7,51) 


/riqhted 
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We have explained the method with simple boundary conditions (7.47) 
where the function values on the boundary are prescribed. In many applied 
problems, however, derivative boundary conditions may be prescribed, and 
this requires a modification of the procedures described above. The following 
examples illustrate the application of the finite-difference method. 

Example 7AS A boundary-value problem is defined by 
yVy+l-0 t 0 <jt£1 

where 

y(0) = 0 and >>())=0, 

With h = 0.5, use the finite-difference method to determine the value ofy0,5). 

This example was considered by Bickley [1968], Its exact solution is 
given by 

1 - cos 1 


y (r) m cos x +■ - 


sin 1 


-sinx-l. 


from which, we obtain 

y{ 0.5) = 0.139493927. 

Here nk = 1, The differential equation is approximated as 

Jh-^QM +a+i.o 

hr 

and this gives after simplification 

y tA ~{2~h 2 )y i +y m --h 2 . i=l % ■ 

which together with the boundary conditions y\ y = 0 and y n =0, comprises 
a system of (n + 1) equations for the (n + l) unknowns y$, y (J .... y„. 
Choosing h = V2 (i e. n = 2)> the above system becomes 

y °"( 2 -^ + ^ = -? 

With y 0 -^ = 0, this gives 

ft =y(0.5) = 1 = 0.142857142... 

Comparison with the exact solution given above shows that the error in the 
computed solution is 0.00336. 

On the other band, if we choose h - 1/4 (i.e. n = 4), we obtain the three 
equations: 

31 1 

31 1 

Vi ■—vj +j*3 - —*r 

1 16 3 16 


31 


1 
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It Is possible to obtain a better approximation for the value of y(1.0) by 
extrapolation to the limiL For this we divide the interval [0, 2] into two 
subintervals with h= 1,0. The difference equation at the single unknown 
point y\ is given by 

To ~2>’i +yi =y\ 

Using the values of and y we obtain 

y, =120895. 

Hence (7,61) gives 

>( 1 , 0 )^ C 118428 )- 120895 = ,., 7606 . 

which is a better approximation since the error is now reduced to 0.00086, 

7.10.2 The Shooting Method 

This method consists in transforming the boundary value problem into an 
initial-value problem. Its main advantage is that it is easy to apply. The 
method requires good initial guesses for the first derivative and can be 
applied to both linear and nonlinear problems. To describe the method, we 
consider the boundary-value problem defined by 

y p W=/W; y(0)=o t y(l)=l< <7 62) 

The main steps involved in this method are: 

(i) transformation of the boundary-value problem into an initial-value 
problem 

(ii) solution of the initial-value problem by any of the known methods,, 
and finally 

(in) solution of the given boundary-value problem. 

To apply any initial value method, we must know y(0). Let the true 
value of y(0) be m. We start with two initial guesses for m and then 
determine the corresponding values of y(l) using any initial value method. 
Let the two guesses for m be pti & and m] and also let the corresponding 
values of y(l) be 7$ and f|, obtained by the initial value method. Using 
linear interpolation, we can then obtain a better approximation m 2 for m . 
This is given by 


m 2 -m & tn Y - m 0 
y{l)-7 0 ' ' 

which gives 


(7-63) 


m 2 =m$ + 0^ - nip}. 


ym-m 


(7,64) 


Copyrighted material 


Presented By: http://www.ebooksuit.com 



324 Chapter 7 ; Numerical Solution of Ordinary Differentia] Equations 


With this value of m 2 , we solve the initial value problem 

/'(*) = /(x); y(0) = 0, /{ 0)^m 2t (7.65) 

and obtain 1^- If this agrees with y(l) to the desired accuracy, the solution 
to the boundary-value problem is obtained. Otherwise, linear interpolation is 
carried out with (m,, fj) and to obtain The process is repeated 

until convergence is obtained, i.e, until the value of Y t agrees with >(1) to 
the desired accuracy. The speed of convergence depends on how good the 
initial guesses were* The method will be tedious to apply to higher-order 
boundary-value problems and in the case of nonlinear problems, linear 
interpolation yields unsatisfactory results. 

The method is illustrated with a simple linear second-order boundary- 
value problem. 

Example 7.17 Solve the boundary value problem 

/'(x) = y(x); y{0> = 0, y(l) = 1.1752. 

by the shooting method, taking m Q =0.7 and = 0.8. By Taylor's series, 
we have 


y(x)=ym* ^’(0)+4y'(o>+^y*'(o)+—y*«» 

2 6 24 

120 720 


Since y'(r) = y(jr), we have 


(i) 


y tr (x) = y\xl /‘(x)=y"(xy=y(x\ 
y'{x) = y\x). y Ti W = /(r)=)<r) t .., 

Putting x = 0 in the above, we obtain 

/ r (0)=y(o)=o, 

/'(oj-q, /{0) = /(0) J .~ 

Substitution In (i) gives 

( x 3 x 5 x 7 x* "l 

y(x) = /{Q) x + —+ 4~ + -4~ + —since y( 0)=0. 
{ 6 120 5040 362800 ) 


Hence 




flD 


With /(0) «> mid = 0,7, (ii) gives 

y(L)«T o =0J226. 


}py right 
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If we divide the interval [0* 1] into two equal subintervals, then from 
Eq + (7,62) and the recurrence relations for M h we obtain 

>.( 0 - 5 )= 0 . 13636 , 00 

Then 

M 0 =-[, «1=“. «2=-l 

Hence we obtain 

*' (0>= gi' 4 ' {1) = "H’ s ' {0 - 5)=0 

From the analytical solution of the problem (i) T we observe that y(0.5) 
= 0.13949 and hence the cubic spline solution of the boundary-value of the 
problem has art errOT of 2,24% (see Biekley [1968]), 

Example 7J9 Given the boundary-value problem 

x 2 y" + xy’-y = 0-. >■(]) = 1, >>(2) = 0.5 

apply the cubic spline method to determine the value of y(1.5), 

The given differential equation is 


„ l , l 

y -—y 

x x 2 


(i) 


(ii) 


Setting x - x f and y"(x ( ) = Af], eq, {i) becomes 

w I | I 

M i =-J^+-7». 

*/ x f 

Using the expressions in (7.67) and (7.68), we obtain 

= + < = 0, l, 2 ,..., n - 1 . (iii) 

3 6 h / *1 


and 


“i — 


1 (h 






yt-yj-i 


-jy iT i-b 2,.,,,^ (iv) 


If we divide [1,2] into two subimervals, we have 1/2 and n = 2. Then 
eqs. (iii) and (iv) give 

lOMa-Mj +24^=36 
16M,-Af 2 -32>^~12 
Mq+20M } + 16yi =24 
Af, + 26M 3 - 24>| --9 


/riqhted 
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With h - 1/2, we obtain 

y<i +4 ^i + ?2 *240^-2^ +y 2 ) 
Since - 1, the above equation becomes 

Jb + 4y, -24(>' tt -2y,) + 23 

or, equivalently 


52y 1 -23y 0 + 23 <ix) 

For the derivative boundary condition, we use £q. (7,68) and obtain 

ri-O— 

Since M 0 - y Q and M l the above equation gives 

2y 0 +>i =24(.Vi-y 0 ) 00 

Equations (is) and (x) yield 

COD 

w-yfG.S)- —-0.7266. 

1 823 

Thus the error in the cubic spline solution is 0.0044. This example demonstrates 
the superiority of the cubic spline method over the finite difference method 
when the boundary value problem contains derivative boundary conditions. 


EXERCISES 


7.1. Given 


—= and y(0) = l, 
4r 


obtain the Taylor series for y{x) and compute y(0J) correct to four 
decimal places. 

7*2, Using the Taylor's series method, prove that the solution of 


d 2 y 


is given by 


y = <* 


. jt 3 1x4 6 1x4x7 9 ] 
[ 31 6! 9\ ) 


when the conditions are x - 0, y-d and dykix = 0. 
7.3. If 


dy I 

~r ^~2 ’ 

ax x +y 

where y(4) - 4, compute the values of y£4.1) and >(4.2) by Taylor’s 
series method. 
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7.13. Given the problem 

^ = /(■*>>') and = », 

an approximate value >i at jc s ij is given by the formula 
”Jfo + “ (*i + 4k 2 +jtj) + /? 4 , 

where 

*i =¥{**> ya\ 

h = ty{XQ + K >0 + 2*2 “ * 0 ’ 

Show that Rn is of order A 4 , 

7.14. Tabulate the solution of the equation 

^-x-0V, y(0) = 0 

dx 

for the range 0<j<0,5 at intervals of 0.1. Obtain the solution 
correct to four decimal places, and compare il with the Thy tor's 
series solution. 

7.15. Use the Runge-Kutta method to solve 

I0^ = * 2 +/, y(0) = 1 

dx. 

for the interval Q<jt£ 0.4 with h = 0.1. 

7.16. Use the predictor-corrector formulae for tabulating a solution of 

10“ = jc 2 +y 2 , y(0}= I 

dx 

for the range 0.5 £ jc £ 1.0. 

7.17. Tabulate the solution of 

^ = *+y, y(0)=0 

ax 

for 0.4 < x £ 1.0 with h = 0.1 using the predictor-^corrector formulae. 

7.18. Using Milne's method, find >(0.8) given that 

£ = y( 0) = 0, y (0-2) - 0.02, 

>(0.4) = 0.0795, >(0,6) = 0.1762. 
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7*19. Using Milne's method, solve the differential equation 

{! + *)“ + with y(0) = 2, 

ax 

for x = 1,5 to x = 2.5. Obtain the starting values by using the fourth- 
order Rtmge-Kutta method with h = 0.5, 

7*20. Solve the system of differential equations 




r 


with x = h y = 1 when / = 0, taking At = h = 0.1. 
7.21* Solve the differential equation 

a 




with y{0) = 1 and /(Q) = 0 P using the fourth-order Runge-Kutta 
method with h = 0.2. 

7.22. Given that 


and 


dv 

— = uvw, 
du 


dw uv 
du w* 


v(l) = 5 - wfl) = l. 

compute vfl.l) and w(l,l). 

7,23* Solve the equation 


iz 

dc 2 


+ y=*0 


with the conditions y(0)=l and /(G)=0, Compute y(0.2) and 
y(0.4), 

7*24. Solve the boundary-value problem 

y"-64y+10 = 0; y(0) = yfl>0 


by the finite-difference method. Compute the value of /0.5) and 
compare it with the true value. 

7.25. Use the spline method to solve the initial value problem 
x dy + 2y dx = 0 and y(2) = 1 

7*26. Using the cubic spline technique, solve the following boundary- 
value problems 

(i) y"-y = O p y(G) = 0 and y(l) = l 

(ii) /’ + 2/+ y = 3Q* T y{0) = 0 and y (1) = 0 
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(iii) /'-64y+10 = 0, y(0) = y(l) = O. 

In each case, divide the given interval into two equal snbintervals, and 
compare your solution with the analytical solution at the midpoint 
of the interval. 

7*27. Solve the boundary value problem 

r=yi*% y( 0 )=o, y( 0 =i, 

by die shooting method. 

7,2®, Solve the boundary-value problem 

y"-64y+10- 0; y(0) = y(1)*0 

by the shooting method. 

7J9, Solve the boundary-value problem 

d 2 y % dy 2 n 

dx 2 1 + JT 2 1 + x 2 

with the boundary conditions y(Q) = 1 and y{2) = 0.2. Use the cubic 
spline method first with h = l and then with h = 1/2 to determine the 
value of y(l). Compare your answers with the exact value obtained 
from the analytical solution y = l/(l + jc 2 } [Albasiny and Hoskins]. 

7*30. Solve the boundary-value problem 

j d 2 y dy 

(l + *r—f+(l+jr)”’y^0 ( 

dx 2 dx 

with 

y(0) = l and y(l) = 0.5. 

Use the cubic spline method to determine the value of y(0.5) and 
compare it with that obtained from the exact solution y = 1/(1 + x). 
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CHAPTER 


Numerical Solution of Partial 
Differential Equations 


8.1 INTRODUCTION 


Partial differential equations occur in many branches of applied mathematics* 
for example,, in hydrodynamics, elasticity, quantum mechanics and electro- 
magnetic theory. The analytical treatment of these equations is a rather 
involved process and requires application of advanced mathematical methods. 
On the other hand, it is generally easier to produce sufficiently approximate 
solutions by simple and efficient numerical methods. Several numerical methods 
have been proposed for the solution of partial differential equations, but only 
the finite-difference methods have become popular and are more gainfully 
employed than others. We will therefore restrict ourselves to a treatment of 
the finite-difference methods and, in the sequel, we will discuss, very briefly, 
some of the numerical procedures with simple illustrative examples. Only 
the rudiments of the method will be given here and the interested reader is 
referred to the text by G.D. Smith (see Bibliography) for further details. 

The general second-order linear partial differential equation is of the 
form 


3x 2 fafy 



+ D— + E— + Fu=G, 
dx dy 


which can be written as 


Au^ + Buy + Ctiyy + Du x + Bu y +Fu = G, (8. 1) 

where A t B , C,G, are all functions of x and y. 
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334 Chapter 8: Numerical Solution of Partial Differentia] Equations 

Equations of the form (8,1) can be classified with respect to the sign 
of the discriminant, 

A 4 =B 2 -AAC, (8,2) 

in the following way. If & a <0 at a point in the (jt, y) plane, the equation 
is said to be of elliptic type, to be of hyperbolic type when & s > 0 at that 
point, and to be of parabolic type when & 5 =0. 

In the following, we will restrict ourselves to three simple particular 
cases of Eq. (8.1), namely 

u xx + = 0 (the Laplace equation) (8,3) 

_ ”T Kff “ ® (the wave equation) (8,4) 

c L 

Hja - Uj = 0 (the heal conduction equation), (8.5) 


where (*, y) are space coordinates and t is the time coordinate. It is easy 
to see that the Laplace equation is of elliptic type, that the wave equation 
is of hyperbolic type and that the heat equation is of parabolic type. 

In a similar way, we conclude that the partial differential equation 

xUjk + Uyy = 0 

is 

(i) parabolic if jc = 0 
(it) elliptic if x > 0 
(iii) hyperbolic if x < 0 + 


It is dear that the region plays an important role in the classification of 
partial differential equations. In the study of partial differential equations, 
usually three types of problems arise; 

(i) Dirichiet's problem: Given a continuous function / on the boundary 
C of a region M, to find a function u satisfying the Laplace equation in R, 
i.e, to find u such that 


+ u^, - O in R 


u = / on C 


(ii) Cmichy's problem; 


for t > 0 

u(x, Q) = /{x) 


im 


( 8 . 7 ) 


u,{x r 0) - g(j) 

f(x) and g(x) being arbitrary. 


Copyrighted m 


Presented By: http://www.ebooksuit.com 




SEcrton 8.2: Finite-Difference Approximations to Derivatives 336 


(i!) u t - u a - 0 for / > 0 
u(j, 0) = f(x) 


( 8 - 8 ) 


These problems are all well-defined (or welt-posed) and it is proved in 
textbooks of partial differential equations that they possess unique solutions. 
At this juncture, it is, however, important to mention a point of difference 
between ordinary and partial differential equations. In contrast with ordinary 
differential equations, the form of a partial differential equation is always 
connected with a particular type of associated conditions. Thus, the problem 
of Laplace’s equation with Cauchy boundary conditions, viz., the problem 
defined by 

+ ^yy ~ ® 


*<*,0) = /(*) 


(S.9) 


Hj(x, 0)«g(l) 


is an ill-posed problem 


82 FINITE-DIFFERENCE APPROXIMATIONS TO DERIVATIVES 

Let the {*, y) plane be divided into a network of rectangles of sides Ajc = ft 
and Ay - k by drawing the sets of lines 

x = ih t i = 0 r \,2,r.. 

y = jk, j = 0,1,2,... 

The points of intersection of these families of lines are called mesh points, 
lattice points gt grid points. Then, we have (see Section 7,10 of Chapter 7) 




“i.j -«)-l .] 


+OW 


Wi + . ,-Mj.i . 

- "V / +0( ^ 


and 


where 


= 




%J - ti (iKjk} = u(x i y) 


( 8 , 10 ) 

( 8 . 11 ) 

( 8 . 12 ) 


(8J3) 
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Similarly, we have the approximations 


ti u a* + Q(&) 

«-0 (*) 


k 

ArV l 


= !^L!ki +0 (rt 


(5.14) 

(8.15) 

( 8 . 16 ) 


and 


(8.17) 

We can now obtain the finite-difference analogues of partial differential 
equations by replacing the derivatives in any equation by their corresponding 
difference approximations given above. Thus, the Laplace equation in two 
dimensions, namely 

+ Uyy = 0 

has its finite-difference analogue 

(“f+1*/ " 2 m i. J + u i-ij ) + -2u f j + Mj y_|) = 0. (8. LI) 

If h - k, this gives % 

“ij = +u I-\J +"l.J+l 1 <* 19 ) 

which shows that the value of u at any point is the mean of its values at 
the four neighboring points* This is called the standard five-point formula 
{see Fig, 8*la), and is written 

Uf+ij + Ui_ hi + ^ j+i + u KJ _i -4uj 3 j =0 (8-20) 

By expanding the terms on the right side of (8J9) by Taylor's series, it can 
be shown that 

»M. j + »l- i,J * u l.j *1 + “l,7-l -4 “U = ^ (“a + «») - J + °(*‘) 

s-t^u^ + OfA 6 ) (»-21) 

6 

Instead of formula (8.19), we may also use the formula 

U *J = jC w i-j* j -1 + + w f+t* m + u t -t y+1) (8,22) 
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=i(Hj + c 7 +w 5 ); «2 ="(c 3 +u 3 + u 3 + «,). 

When once all the iq,{i = |, X 3. 9} are computed, their accuracy can 

be improved by any of the iterative methods described below. 


8.3.1 Jacobi’s Method 

Let iiW denotes the nth iterative value of u L y An iterative procedure to 
solve (8.20) is 


„<*+!>_ iffc<*) + tl 04 , 

«./ - 4 L «i-U +J “i+i,/ 




(fi.26) 


for the interior mesh points. This is called the point Jacobi method* 


8.3.2 Gauss-Seidel Method 

The method uses the Latest iterative values available and scans the mesh 
points systematically from left to right along successive tows* The iterative 
formula is: 


u (n+1 > - i Tu 4 , „ 00 4. H <"^0 jl u ( ffl ) 1 f S[ VJ\ 

u i, i s J L« i-i j +« Hi j + K i. J_| + » l J-+I J {9.11) 

It can be shown that the Gauss-Seidel scheme converges twice as fast as 
the Jacobi scheme. This method is also referred to as Utbmam's method. 


8.3.3 Successive Over-reltouttkm SOR Method) 

Equation (8.27) can be written as 

„ <"+■} D i*y . i lu (n+U .,,<*) , „{^n . u 04 _ 4u («) 1 
u i>i su i*j i-L j + “ M. j + %J-l +M i, /+* ** 


«•£?■ 


~ R i j 

4 U 


which shows that (I/4)J?,i j is the change in the value of iqj feu one Gauss- 
Seidel iteration. In the SOR method, a larger change than this is given 
to and the iteration formula is written as 


„ tn+h _ .. ("> , J, m o 
u iJ + 

= ifl) lu +«,-7-i + *'!,>,]+0-H» ■ I'i (8.28) 

The rate of convergence of (S.28) depends on the choice of © T which is 
called the accelerating factor and lies between l and 2. 


Copyright 


Presented By: http://www.ebooksuit.com 



Hidden page 


Presented By: http://www.ebooksuit.com 



Hidden page 


Presented By: http://www.ebooksuit.com 



342 Chapter 8 : Numerical Solution of Parti a] Differential Equations 


=1(1 + 1 + 0 + 0}^ 0.5; 

4 


u S 1 ^ = — (l+1+0+0) = 0.5. 

4 

The iterations have been continued using the formula (8,26). and seven 
successive iterates are given below: 



ih 

ih 

ik 

0.1075 

0,1875 

0.4375 

0.4375 

0.15625 

0.15625 

0.40625 

0.40625 

0.14062 

0.14062 

0.39062 

0.39062 

0.13281 

0.13281 

aassei 

0,38281 

0-12891 

0-12891 

0,37891 

0.37891 

0.12695 

0.12695 

0,37695 

0.37695 

0.12598 

0.12598 

0,37598 

0.37598 


(b) Gauss-Seidei method: Five successive iterates are given below: 


U| 



IM 

0 25 

0.3125 

05625 

0.46875 

0.21875 

0,17187 

0.42167 

0,39844 

0.14844 

0,13672 

0.36672 

0.38066 

0.13086 

0,12793 

0,37793 

0.37646 

0.12646 

612573 

0.37573 

0.37537 


(c) SOR method With c? = U, three successive iterates obtained by 
using the formula (8.28) are given below. 


«i 

Ms 

t H 

Ut 

0,275 

0.35062 

0.35062 

0.35062 

0-16534 

0.10683 

0.38183 

0.37432 

0.11786 

0.121&1 

0.37216 

0.37341 


Example S3 Solve Laplace's equation for Fig. 8.5 given below: 
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We first compute the quantities u 5t u 7t u, it, and ir 3 by using the 
diagonal five-point formula (3,22). Thus, we obtain 

« J" - :s.00; u JP = 42.75; =43.75; 

= 6.25; af=6.25. 

We now compute u it it A , u 6 and u 3 successively by using the standard five- 
point formula (3.20) 

(if 11 = 53.12; « V 1 = 18.75; 

h£> = 18.75; =9.38, 

We have thus obtained the first approximations of aJl the nine mesh points 
and we can now use one of the iterative formulae given in Section 3.3. We 
give below the First-four iterates obtained by using the Gauss-Seidel formula 
(3.27). 


Ui 



u 4 

Uj 

Us 

"7 

Lfg 

% 

7.03 

9 57 

7,OB 

16.94 

25.10 

13.96 

43.02 

52.97 

42.99 

7.13 

9.B3 

7.20 

16.61 

25.15 

18..64 

42.04 

52 77 

42.90 

f.16 

9.08 

7.16 

16.81 

25.00 

1079 

42.69 

52.72 

42.86 

7.17 

9.66 

7.16 

16.76 

25.04 

IS,77 

42.6® 

52.70 

42,67 


Example 8,4 Solve the Poisson equation 

u xx + % =- l 0(* 2 + >' 2 + 10 ). 
in the domain of Fig, 3,6, 


y 

u=0 




c 

□ 




u 4 

u=0 


ir t 

*k _J 



A 

B 



0 1 2 3 * 

figure 8,6 

Let the values of u at the four grid points, A, B, C, D bet » 2 , 
respectively. Let the grid points be defined by x- ih r y = jh, where h =1, 
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i, j = 0, L„ 2, 3, At tiie point A, i = l, j = 1. The standard five-point formula 
applied at the point A gives 

u 2 + Uj + 0 + 0 — 4u; — —10 {l+ 1 + 10) 


he** 


“7(“i + “3+120). 

4 

Again, the standard five-point formula applied at the point B gives 
1*1 +H 4 +0 + 0-4h 2 “ “1® (4 +1 +10} 
i.eu 


(i) 


1*2 — — ( 0 | + u 4 +150) (ii> 

4 

Similarly, the standard five-point formula applied at the points C and D 
gives, respectively: 

Uj - i (y L + u A +150) (iii) 

and 

« 4 = — {»2 + Kj +180) (iv) 

4 

From (ii) and (iii), it is seen that u 2 and so we need to find only 
w 2 and 1*4 from (i>* (ii) and (iv), The iteration formulae are therefore given by 


uf"" l) =-u^+30 
1 2 

“i”*' 1 -t[t<f wl> +i«J' , +150] 

2 

For (He first iteration, we assume that u j°* = ir j® = 0. Hence we obtain 
a I 1 ’=30, 

aJ ) =i(30 + 0 + 150) = 45 
* P=i (45) + 45 = 67. J. 
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quite general but* for easy understanding, we demonstrate its applicability 
with reference to the Laplace equation in two dimensions. For more details* 
the reader is referred to Isaacson and Keller [1966]. 

We consider Laplace's equation in two dimensions* viz.* 


+^ = 0 (8.29) 

and the standard five^point formula 



»H| +* i M p / + M«.y-1 +tf i./+I -4a, y = 0 (8.20) 

The use of formula (8.20) involves the solution of a system of algebraic 
equations, whose coefficient matrix, for w = 6, is of the form 


A = 


-4 

1 

0 

1 

0 

0 


1 

-4 

1 

0 

1 

0 


0 

1 

-4 

0 

0 

1 


t 

0 

0 

-4 

1 

0 


0 

1 

0 

I 


The general form of such a system is given by 


B = 


I 

T 


T 

l 


where T is a tridiagonal matrix of the form 

r-4 i 


T = 


1 


-A 


1 


-4 

I 


1 -4 


1 

-4 


(8.30) 


(8.31) 


(8,32) 


System A is called a block tridiagonal system and such systems are solved 
by Gaussian elimination or, in the case of large systems, by Gaussr-Seidel 
iterations. But tridiagonal system of the type (8,32) are much easier to solve 
than block tridiagonal systems, Hence the question arises as to whether we 
can obtain directly tridiagonal systems in the numerical solution of Laplace’s 
equation, Peaceman and Rachford showed that this is possible and their 
method of procedure, called the alternating direction implicit method (or 
the ADI method) is described below. 
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Section 83; Laplace’s Equation 

We rearrange formula (8,20) in either of two ways: 

u i-U/~* u i.j + ■M. j ~ /-i ~ “i. i*l (8.33) 

or 

~ Au *J = ~^-U ~ u t+iJ J4 > 

The ADI is an iteration method and formulae (8.33) and (8.34) are used as 
iteration formulae 


a 


ir+1} 
t-U 


-4 u 


(r+L) 


+ H 


O+l) _ 
tHJ “ 


—u 


(» 


-it 


(r) 
i,J+1 


(8.35) 


and 


, (r+2> 
tj- 


, {r+2) 
Uj 


, lr+2) _ 

u+l “ 


, {r+n 

i-Li 


Ar* l> 
f i*U 


(8.36) 


Formula (8.35) is used to compute function values at all internal mesh 
points along rows and formula (8 ,36) those along columns. For J - 1 F 2, 3, .,,, 
n-1, Eq. (8.35) yields a tridiagonal system of equations and can easily be 
solved. Similarly, for i - 1, 2, 3 M <», fl —1, Eq. (£.36) also yields a tridiagonal 
system of equations. 

In the ADI method, formulae (8,35) and (8.36) are used alternately* For 
example, for the first row j = l, and formula (8.35) gives 




it = 1 , 2 , 3 , 1 ) ( 8 .^ 7 ) 


Together with the boundary conditions, Eqs. (S 3 7) represent a tridiagonal 
system of equations and are easily solved for a ■, We next put / * 2 and 
obtain the values of on the second row, the process is repeated for 

all the rows, viz, up to j = n-1. We next alternate the direction, i.e. we use 
formula (8.36) to compute uj r J 2 \ It is easy to see that at every stage we 
will be solving a tridiagonal system of equations. Example 8,5 demonstrates 
the method of solution. 


Example 8,5 Solve Laplace’s equation, + a }y =0, in the domain of 
Fig. 8,7 (see Example 8.2). 


fq,a ^2,3 



1 

1 

W CL1 

W l,2 

#z,z 0 

0 




#1.1 



6 

0 


U 0,0 #1.0 #2.0 

Figure 8.7 
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Substituting the boundary values and solving the above equations, we obtain 

iif? = — *0.1778 and u S 3 ?*—=0.3778 
11 45 U1 45 

To compute the values on the second column, we now set / = 2 in (06) 


a f» -4 u a) +u a} -- u W-uM 
Putting j = 1 and j = 2 in the above, we obtain the equations 


(iv) 


fl-J 


(I) 


and 


u (2) * (2) a) m _ m 

U M * U 2,l +U U “ w 1.2 u 3.2 


Substituting the boundary values in the above two equations and solving 
them, we obtain 


u = 0 J 778 and u = 0.3778 

The iterations are continued to improve the function values obtained first on 
the rows, then on the columns, and so on. The reader is advised to continue 
these computations for the next iteration. 


3.4 PARABOLIC EQUATIONS 

We consider the heat conduction equation: 
du 

C being a constant. (8,38) 

dt dx 2 

Let the (x T f) plane be divided into smaller rectangles by means of the sets 
of lines 

x-ih, J-0,1, 2,... 

y-o,L, 2,.„ 

Using the approximations 

du _ "U4l -Ujj (8.39a) 

dt * 

and 

B 2 u 1 

^■ = ^-(u,_ LJ -2u, y + i, (H P (8.39b) 

Eq. (8.38) can be replaced by the finite-difference analogue 
C 1 

~ H y+i j- 2u i t j+ %4-J 
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which can be written as 

u t j+\ = + u i-ij " 2u ij + u t+\j )■ (S 40a) 

where X = kf(Ch 2 ). 

This formula expresses the unknown function value at the (i *j + 1 )th 
interior point in terms of the known function values and hence it is called 
the explicit formula. It can be shown that this formula is valid only for 
ft <k£ 1/2. 

For X = 1/2, Eq. (8*40) reduces to 

«I.J +1 = | (“w, j + U M.A ( S40b ) 

which is called Bender-Schmidt recurrence relation. 

In formula (8,40a) + we have used the function values along the /th row 
only in the approximation of d^u/dx 2 . 

Crank and Nicolson proposed a method in 1947 according to which 
cftuftk 2 is replaced by the average of its finite-difference approximations 
on the /th and (/'+ l)th rows* Thus, 

d*U 1 ( w i-l, j - 2u iJ +■ M i+|, J W M. >41 _ 2«i,/+l + ty+1, j+\ ' 

df~2{ & + A 2 } 

and hence Eq. (3.38) is replaced by 
C 1 

~ 1 ” *9, /) = > ” Zufj + ^4i. / + u i-\, j+\ - 2u rj+\ + w hi,/+i)> 

which gives on rearranging 

+ j +( 2 — IXpf^j+kUi+i'jt { 8 . 41 } 

where X - i^CA 2 ). 

On the left side of (8.41) we have three unknowns and on the right side 
all the three quantities are known. Equation (8*41), which is an implicit 
scheme, is called Crank— Nicolson formula and Is convergent for all finite 
values of A. 

If there are N internal mesh points on each row, then formula (8.41 ) gives 
jV simultaneous equations for the N unknowns in terms of the given boundary 
values* Similarly the internal mesh points on all rows can be calculated. 

Example 8.6 Use the Bender-Schmidt recurrence relation to solve the 
equation 

du 

<k 2= dt 

with the conditions 

mU 0) = 4x-x 2 > y(0.0 - ti(4, t) - 0. 
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Taking k = 1, we obtain 

k = -h 2 C = L 
2 

Also* y(0,O) = O* wa,0) = 3* uC2 p 0) = 4, *(3*0) = 3, and w(4*0) = Q. For the 
first time step, Jt«l, Using the Bender-Schmidt recurrence relation, we 
obtain 

Bu= I ( 0 + 4) = 2, U y=I(3 + 3>=3, »„=I{4 + 0) = 2. 

For k - 2, we have 

« u =i(0+3) = 1.3. U jj =^(2 + 2 )= 2 , “ 3,2 =—(3 + 0) *1.5, 

For k - 3 T we obtain 

■y=i(0+2)«l. bj,j = ^(1.5 +1.5) = 1.5, « u =i(3 + 0)«! 

With Jt = 4, we have 

“i,4 =^(0 + 1.5) = 0.75, «j i4 -~(l + i>=], uj,4 = j(1.5+0} = 0.75 

Similarly with jfc=5, we obtain 

*1.5 =^(0+1-0)=0.5, k 25 =^(0.75 + 0.75) = 0.75, a„ =i(l + 0)=0.S. 

Hie computations can be continued to any number of time steps. 
Example 8,7 Solve 

du _ d 2 u 
Sr ~ dx 2 

subject to the initials condition a = sin xx at f = 0 for 0 £jc£ 1 and the 
boundary conditions w = 0 at r = 0 and x - 1 for t > 0. Take h - 0.2, X - I 
and compute the values of u at the internal mesh points up to two time 
steps. 

We have h = 0,2 and A = l. Hence k-h 1 - 0,04, 

The Crahk-Nicolson formula corresponding to A = l is 

*H/ti * A v tJ+ 1 + v, H/+l = - u HV j . (0 

Applying (i) at the mesh point m t , we obtain 

0 - 4vj + *j « -0,951 h ffl 

Again, applying (i) at v 3 , we get 

*, - 4w 2 + u 3 = -0.5878 - 0.9511 = -L5389. (ui) 

Similarly, application of (i) a! the mesh points and u 4 gives, respectively; 

u 2 - 4»j + 114 - +0.9511 - 0.5878 = -1,5389 (iv) 
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and 

uj-4u + =-0.951 L (v) 

By symmetry, we have u } = h 4 and u 2 - u 3 . 

Hence, eqs. (ii) to (v) reduce to the two equations: 

4u, -U2 = 0.9511, u s - 3u 2 = -1.53 89, 

the solution of which is 

«i =03993 and 1*3=0.646], 

For the second time step, let u 5t u 7 and i* 8 be the values of u at the 
internal mesh points. Then* applying formula (i) at these mesh points* we 
obtain 

-4iij +i<$ — —0,6461 

«5 - 4w e + a 7 = -03993 - 0.6461 - -1.0454 
Ufi — + wg = -| .0454 

u 7 -4% ^-0.6461. 

By symmetry, t* 5 = u t and * 6 - uj. Hence the above equations reduce to the 
two equations: 

-4% + *& = -0.6461 and h; -3h* = -1.0454, 
the solution of which is 

u 5 =0,2712 and u 6 = 0.4387, 

Example #J Solve the heat equation: 

du _ d 2 u 
a "at 2 

subject to the conditions 

u{^0} = 0, *{0,0 = 0, u(ht)^t 

(i) We first choose Jt - 1/8 and h ■ 1/2 so that A = k/h 2 = 1/2. The Crank- 
Micolson scheme <8.41) now becomes 

+ &<#,i+L ^ h j+] f /+l -j + * u i, j + w/+j N y (D 

Let the value of u corresponding to t = 1/S and £ = 1/2, i.e. at the mesh 
point P be (see Fig, 8.8). Applying the Cmnk-Nicolson scheme (i) given 
above at this point, we obtain 

0 + 6*! - - = 0 which gives u t = 0.02083. 

8 
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(ii) We mow choose k = 1/8, h = 1/4 so that A = 2 {see Fig. 8.9). Hie 
Crank-Nicolson scheme corresponding lo this value of A is given by 

“*9-1* j+ 1 + H/+1~ u t+i.j+i ■ u i- 1. j- u t,j + *9+i* r (■*> 

Applying the above equation a! the mesh point P, we obtain 
0 + 3ti| — “ 0 or 3v[ = uj 



Figure 8.§ 

Similarly, applying the same equation at the mesh points Q and R> we obtain 
the two equations 


-U| + 3uj - = 0 and 




We have thus three equations in the three unknowns u it u 2t w 3 and the 
solution is 


Ml = 0.00595, «2 = 0.01785, i# 3 = 0.04760 

(iii) As our final choice, we choose Ir = l/l6, h =1/4 so that A = ]. This 
means that we propose to find our solution for t = 1/S in two steps instead 
of one as in (i) and (ii) above. 
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The Crank-Nicolson scheme corresponding to this value of X is now 

"%-W+i + 1 “ " <fr-L J + u i+lJ ' (in) 

Applying the scheme (ill) above at the mesh points P f Q and R, we obtain 
the three equations: 

4uj - u 2 — 0 8 +4*i 2 -m 3 -0* -u 2 +4u 3 0 

1$ 

whose solution is 

1 1 15 

u .=-—h,e- - f ii,*- 

1 55x16 1 56x4 J 56x16 

Again,, applying the scheme (hi) at each of the mesh points X, Y T Z in 
Fig. 8.10, we obtain the three equations: 

4 "4-“5=7-^ 


-«4 + 4tr 5 -U6= — 

. 1 1 1 
-^ + 4u t - r — + - 



—-u-0 
Figure 3,10 


Hie solution is 

u 4 = 0.GQ5S99, uj - 0.019132, - 0.052771 

Hie exact solution of the problem is given by Froberg: Introduction to 
Numerical Analysts, p. 269. 

n{x, O = - (je 3 - x + 6 xj)+V ■ sin m 

6 tr nM n* 
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which gives 

“(t-s)-°- <W i41 ' “ [{’ i)= 001 ™' *(fJ)- 0 05240 

BM ITERATIVE METHODS FOR THI SOLUTION OF EQUATIONS 


The iterative methods discussed in Section 8,3 can be applied to solve the 
finite-difference equations obtained in the preceding section. In the Crank- 
Nicolson method, the partial differential equation 

du c?u 

a "at 3 

is replaced by the finite-difference equation 

(l+'-)“i./ + i ="t./ +^'•(“1-1.+“f+i,y + “i + i,/*i + "<-!./ ~ 2u >.j) 
where r -A//r ? . 

In Eq. (8.42), the unknowns are i^ i y + |*a l _ t y +l and n i+ i pJ> | p and all 
others are known since they were already computed at the /tb step. Hence, 
dropping the /§ and setting 


^ - *i, j + 2 r ( v i-\j ~ Hi ^%+w) 
Eq. (8.42) can be written as 

“' = ioT7I < “‘- + “- )+ IT7 

From Eq. (8.44), we obtain the iteration formula 


(8-43) 

(8,44) 


, (n+l> 


2(1 + .) 


^a+-jS]+ 


\+r 


(8,45) 


which expresses the (n+1)th iterate in terms of the rath iterates only, and 
is known as Jacobi's iteration formula. 

It can be seen from Eq, (8,45) that at the time of computing 
the latest value of namely u is already available. Hence, the 

convergence of Jacobi's iteration formula can be improved by replacing u 
in formula (8.45) by its latest value available, namely by u Accordingly, 
we obtain the formula 


„ ~— [a £*«> + »fcV^- 

i 2(1 +r) M M l+r 


(8.46) 
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which is called the Gauss-Seidel iteration formula. It can be shown that the 
scheme (8.46) converges for all Finite values of r and that it converges 
twice as fast as Jacobi’s scheme. 

Equation (8.45) can be rewritten as 

lf 0*H>, it wJ r r „ t«+t) | „(")i . „ (*)] 

“< l2CI + rj [ M *“« ] + TT7 ■' J 

from which it if clear that the expression within the curly brackets is the 
difference between the nth and (n + l)th iterates. If we take the difference 
to be iB times this expression, we then obtain 


.Ot+D-yM 




r +&>< 


2 (1 +r) 




(**!} 




(8,47) 


which is called the successive over-relaxation (or SOR) method. # is called 
the relaxation factor and it lies, generally, between 1 and 2. 


Example 8.9 Solve 

du _ d 2 u 

a ” & 2 

subject to the initial condition u = sin sx at t = 0 for 0 s x £ 1 and u = 0 at 
x = 0 and x -1 for f > 0, by the Gauss-Seidet method. 

We choose h = 6.2 and k = 0.02 so that r -Mk 2 -1/2. The formula 
(1.46) therefore becomes 

Let the values of ir at the interior mesh points on the row corresponding to 
r = 0.02 be uj, uj, Uj, as shown in Fig. 8.11* 







. t 



Vz 

w 




0 0.2 0.4 0,e o.a 1.0 

o.o o.50re 0.8511 osere o.osii on 

Figure 0.11 
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Applying the formula (i) at tie four interior mesh points, we obtain successively 

u f"* 1 ’ - -7 W+« f } 3+! f0.5878 + 1(0- 2x0.5878+ 0.9511)1 

4 


= +0.3544 


H 


J 


(ii) 


„<»*•) = i [ B }» +| ) + „<»)]+1 [o,9511 +1 (0.5 878 - 2 x 0.9511+0.9511)] 


= i[«{ wl) +aj ,,, ]+0.5736 


(iii) 


[ M) = ' [u (-4 +1( W ] 2 


0.9511 + -(0.9511-2x0.9511 + 


0.5878) i 


= l[ai” l> +“4 n, ] + 0S736 


(iv) 


« { w ' l> = 1 [a^ 1 * + 0] + 1 ^0.5878 +1(0.951 1 -2x0.5878 + 0.0) J 


= - u 1" +1) +0.3544 


(v) 


Formulae (ii), (iii), (iv) and (v) can now be used to obtain better approximations 
for «], u Zi v 3 and u it respectively. The table below gives the successive 
iterates of u ]t u 2 , u 3 and u 4 corresponding to r=Q,02. 


X 

u(jt) 

00 

0,0 

0.5878 

0,4 

0.9511 

0.6 

0-9511 

0.8 

0,5878 

vo 

0.0 

o 

II 

t 

0.0 

0.5878 

0.9S11 

0.9511 

0.5878 

0.0 

p= 1 

o.o 

0.5129 

08176 

0.8078 

0.4880 

0,0 

rt-2 

0.0 

0.4907 

0,7900 

0.7868 

0.4055 

0.0 

nm 3 

0.0 

0.4861 

0.7858 

0.7855 

0.4853 

0.0 

fl"4 

0,0 

0,4854 

Q.7854 

0-7854 

0.4853 

QQ 

n = 5 

0.0 

0.4853 

0.7854 

0.7854 

0.4853 

0.0 


The symmetry of die solution about x - 0+5 is quite clear in the above table. 
The analytical solution of the problem is given by u = sin jtt and the 
exact values of m for x - 0+2 and x = 0.4 are respectively 0.4825 and 0,7807. 
The percentage error in both the solutions is about 0.6%, and the error can 
be reduced by taking a finer mesh. The reader should check some of the figures 
given in the table.* 

•For the derivation of a more general finite-difference representation of the 
parabolic equation, see the paper by Sastry [1976]. 
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BS HYPERBOLIC EQUATIONS 

We consider the bound ary-value problem defined by 


% =c3 “» (*-48) 

M(*.0) = /(») (*.49) 

U ,(i,0) = #M (8.50) 

«( 0,0 = ^(0 (*. 51 ) 

«ao=nw (*52) 


for OsfsT, which models the transverse vibrations of a stretched string. 
As in the previous cases, we use the following difference approximations 
for the derivatives 

and 

«a = ^( u l.j-l- 2u lj 

where x - ih, i - 0, 1* 2, and t = jk t j = 0, l t 2,,., 

Further, y f (x, /) is approximated as follows 

U|(li , )= ?yii^d + 0{* J ) 

Substituting (8.53) and (8.54) in (8.48), we obtain 
l c 2 

p'Ofyj-i - j + tij F jt+i) = ~ 2**iJ + "j+!*_/) 

Putting a = ckfh in the above and rearranging the terms, we obtain 

“/j+l “ -'hj-i + +h, +w )+2(1 - a 1 ) u t j (8.56) 

Formula (8.56) shows that the function values at the /th and {j - l)th time 
levels are required in order to determine those at the (/ + l)th time level. 
Such difference schemes are called three level difference schemes compared 
to the two level schemes derived in the parabolic case. 

By expanding the terms in (8,56) as Taylor’s series and simplifying* it 
can be shown that the truncation error in (8.56) is C^A 2 + /?). Further* formula 
(8,56) holds good if which is the condition for stability. 

There exist implicit finite difference schemes for the equation given by 
(8.48). Two such schemes are 


(8J3) 

(8.54) 

(8.55) 
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u iJ +1 + Vtj-i c 


■^jK u IH>+] “ 2u iJ+l + "/-U+l) 
+ ( u (+IJ-l -1 %-l +l H/-i)1 


( 8 . 57 } 


*0+1 ~ 2u iJ + »YJ-] cr 2 f , * 

-P-^[fa+l^]-^U+l +lf MJ+»> 

+ -2u J./ + *Mj) 

+ ("ftU-l “ 2w iJ-l + *f-|,/-I>] 


( 8 , 58 ) 


Formulae (8.57) and (8,58) hold good for all values of ck/h. The use of 
formula (8.56) is demonstrated in the following examples. 

Example BJ& Solve the equation 

&u c?u 
Bt 1 dx~ 

subject to the following conditions 

u(0 t f)=O t w(U) = 0 t> 0 
and 

a 

— (x T 0) = 0, u (x*0} = sin J ( jtjc) for all x in 0 £ jc £ L 

Bt 

This problem admits an exact solution which is given by 

3 j 

u(jc, r) = — sin xx cos xt — sin 3/rr cos lift (i) 

4 4 

We use the explicit formula given by (836), viz,, 

where a=t<l (ii) 

Let h = 0.25 and Jr = 0.2. Hence a - 0,2/0.25 - O S, so that the stability 
condition Is satisfied. Let =u(ih t jk), so that the boundary conditions 
become 


U Q,J 

«4J =° 


UjQ / = 1 , 2 , 3 , 4 
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and 

"jj “^-i s 0 so that ,]=w ; | t tvi) 

Substituting the value of a = 0,8, eq, (ii> becomes 

/+, = +0.64(u j _| > + 1 ^) + 2(0.36) u,j (vii) 

At the first step, j = 0 and the above equation becomes 

Ujj + Q.64 y +i* h> ) + 2(0.36 }u u 

or, 

Utj =Q32(u^ KJ ±u M j)+®Mti Ut <viii) 

using (vi) 

Hence »l p i = 032 (i t$j + u^) + O.36i^ 0 

= 032 (0+l) + 036(0.3537) 

= 0 4473. 

The exact value u (0.25,0.2) -0.4838. 

Again, 

*2. i = 0.32 (03537 + 03537)+036 (1,0) = 03867 
Exact value “ 0,5296, 

Finally, 

uj i ■ 032 (1.0 + 0) + 0.36 (0.3537) - 0,4473 
Exact value - 0.4138* 

The computations can be continued for 7 = 1, 2„. + . 

Example 8.1! Solve the boundary-value problem % - 41*^ subject to the 
conditions: 

u{<K 0-0 = u(4, t% u t (x, 0) - 0, u(r, 0) = 4x-x 2 . 

We take and ct ® 1 so that it* 1/2 = 03. 

Since u(0,/) = h( 4»/) = 0, u vanishes from *=0 to x=4, i.e, 

«t) p y*« 4 i |=0 for ally. 

Again, since w,(x, 0) = 0, we have 

7k 

or 

*^j ”*%,-[ “0 for j = 0. 

The above relation shows that the values of u are the same for j » \ and 

y—i- 
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Finally, u{x t 0) = 4x-x 2 gives 

k, 0 = 4W 2 , since A «i, 

Then 

"Qp »U “3. *^0 = 4 t ^0=3, W4 t0 =^ 

Now* for a = ], Eq. (£.56) becomes 


“U+l ” + M H. / + «f+U 

For / = % the above relation gives 

H|,1 -^,-|+^-l f O+«M p O 


or 


\i = 2^1.0 +M i+i.o>t 


since u ( j = ^_ L > 



Figure B,12 

From Fig. 8,12, we obtain 


B U = j +tf 2 t o) = 2 ( 0 + *) -2 * 
U2l =I(l + 3) = 3, 

«3,l =^(4+0)=2. 

For k = \ f we use eq. (i) with J - 1: 

Hj.i “ o + *M,i + 


(i) 


Presented By: http://www.ebooksuit.com 


Copyrighted material 



Hidden page 


Presented By: http://www.ebooksuit.com 



Hidden page 


Presented By: http://www.ebooksuit.com 



Hidden page 


Presented By: http://www.ebooksuit.com 




Any equation in which the unknown function appears under the integral sign 
is known as an integral equation , When the limits of the integrals are 
constants, we have a Fredholm equation. For example, equations of the form 

b 

Jj C(V)/(0<ft=#x) (9.1) 

a 

and 

b 

X j K(x,t) m dl = /(x) + <«x) (9.2) 

a 

are called linear Fredholm integral equations of the first and second kinds 
respectively. In each case the unknown function is f{x ) and occurs to the 
first degree, ${x} is a known function and the kernel K{x t t) is also known, 
[f the constant b in Eqs, (9J) and (9-2) is replaced by x, the variable of 
integration, the equations are called Voherra integral equations , For example, 
x 

X J K(x.l) m d, = /(x) + ^x) (9.3) 

a 

is the Volterra integral equation of the second kind. 

If ^(jr) = 0 in Eq. (9.2), then the equation is called homogeneous, otherwise 
nonhomogeneous. For nonhomogeneous equations, X is a numerical parameter 

3*5 
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whereas for homogeneous equations it U an eigenvalue parameter because 
in such a case the integral equation presents an eigenvalue problem in which 
the objective is to determine those values of jl, called the eigenvalues for 
which the integral equation possesses nontrivial solutions called eigenfunctions. 

If the kernel j£(x, t) is hounded and continuous, then the integral equation 
is said to be nomingubr^ If the range of integration is infinite, or if the 
kernel violates the above conditions, then the equation is said to be singular. 

To solve an integral equation of any type is to find the unknown function 
satisfying that equation. In practical cases, however, the solution of an 
integral equation by analytical techniques is out of the question, and hence 
it would be necessary to adopt a numerical method of solution, 

Fredholm Integral equations, particularly those of the second kind, occur 
quite frequently in practice and hence, we restrict ourselves, in this chapter, 
to a brief treatment of numerical methods for the solution of nonhomogeneous 
linear Fredholm integral equations of the second kind. Before presenting 
these methods, it would be instructive to demonstrate the relationship between 
integral equations and initial-value problems. This is shown in Example 9.1 


Example 9,1 We consider the initial-value problem 

y" + y- 0, with y(0) = 0 and /(O)-1 
Let 


£y 

dx l 


= «(*) 


Integrating both sides of (9.5) with respect to x t we obtain 

. * * 

^ | u(x)A+/(0) = | u(x)dx + l 


(9.4) 

(9.5) 


on using the given condition, Integrating the above with respect to *, we get 


X 

y{x}= | (x-f)u(f)dr + x (9.6) 

o 


Substituting (9,5) and (9.6) In (9.4), we obtain 

X 

w{jO + J (Jt-0 u(t) dt + x = 0 
0 


or u(x) = -x + J (r - x) «(f) dt t 

o 

which is a Vo Item integral equation . 


/riqht 


Presented By: http://www.ebooksuit.com 



Section 9*2: Numerical Methods for Fredholm Equations 367 

9,2 NUMERICAL METHODS FOR; FREDHOLM EQUATIONS 

There exist several methods for the numerical solution of Fredholm integral 
equations of the second kind, e.g. method of degenerate kernels, method of 
successive approximations, collocation and product-integration methods, etc. 
We present a few of these methods, in a formal way, with simple examples. 
For error estimates and other details, the reader is referred to Atkinson 
[1971]. 


9.2.1 Method of Degenerate Kernels 

We consider the integral equation 

b 

fU)-\KU.!)mdt = 4>x (9.7) 

a 

A kernel K(x, I) is said to be degenerate if it can be expressed in the form 


*(*>0 = 2 (0 


I«1 


Substituting this in (9J>, We obtain 

* r 

/«-2 \“,M'>,n)/(i)di=m 


Setting 


Eq. (9.9) gives 


Jv, (0/(0 dr =4 


fix) = T 4h,(x) + $ x) 


(9.K) 


(9.9) 


(9.10) 


(9-li) 


i=i 


The constants A t are still to be detemtned, but substituting from (9.11) in 
(9.19), we get 

b 


} v,(0 


2 V/W+dKO 

u-• 


dt~Jj 


or 


n * » 

^ A j J V|( 0 ii / (/)dr+ | v l (f)tft)dt = A tt (9.12) 

a a 

which represents a system of n equations in the n unknowns dj* > , 
A n , When the A k are determined, Eq. (9.11) then gives f(x). 
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Although the method is important in the theory of Integra! equations, it 
does not seem to be much useful in the numerical work, since the kernel 
is unlikely to have the simple form (9.48) in practical problems. In general, 
however, it is possible to take a partial sum of Taylor’s series for the kernel. 
This is shown in Example 93. 

Example 9J We consider the equation 

*n 

f{x)-X J sin x cos r/(/) dt - sin jc. 
o 

Setting 

it/2 

| cos tf{l) dt = A, (i) 

o 

the integral equation becomes 

/(x) = AA sin x + sin x - (AA +1) sinr. 

Substituting this in (i}„ we obtain 
xtl 

J cos?(AA+1)siurdir = A, 

o 

which gives on simplification 


Hence the solution of the Integral equation is given by 

/(*)■—»* a*2). 

By direct substitution the reader should verify that this is the solution of the 
given integral equation. 

Example 9.3 Solve the integral equation 

+3x-l)+ J -l)xf(t)dt 
0 

We have 

Kit, t) = (e-^ -1)* 


f-4 



= _,V + Jv,«, 

2 

neglecting the other terms of the Taylor's series. 
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Hence the given integral equation becomes 

i 

2' ' J\ 2 


/(*) =I{*~ + !*-])+ | (-*V +IjV)/(i}* 
0 


i{e-* + 3I-1)-! 2 J l 2 f(t)dl H-i* 3 J<V(0i* 


I 


where 


and 


= -{e“ T + 3i - ]) - h* 2 +\k^ f 
2 2 


l 


jc, - 

0 




Substituting for /{/) from (i) in {ji) t we obtain 


K { = \ I 2 [ifc-' + 31 -I)- K/ + i JC 2 ( 3 1 A 

fi L- -1 


Since 


eq. (iv) gives 


frV f c#~2--> 

j - 


6A r , K 2 5 | 29 


5 12 2e 24 

Similarly, substituting for/(f) in (iii) and simplifying, we obtain 

7 16 2e 20 

Solution of (v) and (vi) is given by 

AT, =0.2522 and K z =0.1685. 

Hence the solution of the given integral equation is 

/(jE)=i(e“ r +3x-l)- 0.2522x : + i(0,1685)* 3 < 
z z 


(i) 


0i) 


(iii) 


(iv) 


(v) 


(vi) 
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9.2.2 Quadrature Methods 

We consider the integral equation in the form 

b 

fix)- J K{x ,()/(0 dt = *K*). (9.13) 

a 

Since a definite integral can be closely approximated by a quadrature formula, 
we approximate the integral term in (9.13) by a formula of the form 

* 

J f(*)ifc=£ (9-14) 

H m»l 

where A m and x m are the weights and abscissae, respectively. Consequently, 
(9,13) can be written as 

/(*)- £ A„K{x, t M )f{t M ) = m. (9.15) 

m = l 

where are points in which the interval (s t A) is subdivided. 

Further, Eq. (9J5) must hold for all values of j in the interval ( 0 , A); in 
particular, it must hold for g = f Ll jc«sf Z|1 „, x - V Hence we obtain 

/(',)-£ i-U. n. (9.16) 

M = l 

which is a system of n linear equations in the n unknowns /(fjX/friX 
When the f{t t ) are determined, Eq* (9d5) gives an approximation 
for /(x). Obviously, different types of quadrature formulae can be employed, 
and the following examples demonstrate the use of trapezoidal and Simpson’s 
rules. 

Example 9.4 Solve 

l 3 5 

/(*)- _[(*+0/(0<*=■;*“ (0 

o 2 6 

By direct substitution, it can be verified that the analytical solution is 
given by /(*)■*-!. For the numerical solution, we divide the range [0, IJ 
into two equal subintervals so that h ™ 1/2. Applying the trapezoidal rule to 
approximate the integral term in (i), we obtain 

/W- j j* /o + ' 2 {x +“ j/ii + (* + 1 >J 2 j = | * ■-1» where f t = /{*,). 


Presented By: http://www.ebooksuit.com 



_ Section 9.2: Numerical Methods for Fredholm Equations 371 

Setting * where f 0 =0, f| =1/2 and t 2 =1, this gives the system of equations 


12/ fl -3Ji-3 / 2 = -10 
-3fu + \2f\-9f 2 = -2 
-3/ 0 -9/ 1+ 6/ 2 =a 


The solution is 

h~“* = “ £ > A"*2‘ 

Oft the other hand, if we use Simpson’s rule to approximate the integral 
term in (i), we obtain 


;[* /o+ 4 H) 


fix) - 7 1 j/ o + 41 x + 7 |>S + (* + O /2 


_3 r 5 
2* 6 


Setting *“fi, we get 


The solution of which is 


6/o-2^-/ 2 =-5 

-A+4/ r -3/i»-l 

'/o-6/l + 4/ 2 = 4 
1 


/l— j. /a=o. 


Using these values in (ii). we get 


/w= i[- JC+ 4 ( I+ i)(_i| + | J .5 


(ii) 


- x -], which is the exact solution. 


It should be noted that Simpson's rule gives exact result in this case since 
the integrand is a second-degree polynomial in L 

Example 9.5 The integral equation 


>10 + J A:(t, j)y(i)^ = h 

-1 


(i) 


where 


n 


1 

1 + (j-j) 2 


(ii) 


>y right 
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occurs in an electrostatics problem considered by Love [1949], and is called 
Love's equation. Hie analytical method of solution, suggested by Love, is 
somewhat laborious and various numerical methods were proposed. The 
simplest is to approximate the inegral term in (i) by the trapezoidal rule. For 
this we divide the Interval (-1, 1) into n smaller intervals of width h, the 
Mi point of subdivision being denoted by s h such that 

+ i = 0, 1, 2,..., n 

and nh = 2. Denoting X*i) by Yt* gives 


A-! J ;+i 

Yi + X | = 1 , 

Approximating the integral term by the trapezoidal rule, the above equation 
becomes 


n-i , 

j~q 1 

which can be rewritten as: 


r p pa “ H 

Yt+-K(x f ,3Q)yo + -K(x ft s n )y n +k ]T K(x t ,Sj)yj -1 (hi) 
2 1 j =l 

for i = 0, L Equation (iii) represents a system of (n+1) linear 

equations in («+ 1) unknowns, via., y^,.and was solved on a 
digital computer. The solution is symmetric and the computed values of 
y(x) at jc = 0 and x = 1 are given in the table below. For comparison, the 
exact values are also tabulated. To study the order of convergence of the 
method, computations were made with different values of «, The border 
of convergence of the trapezoidal rule is quite revealing. 


X 

fjfflc t 

n 

Computed yW 

Errof 

Ratio 

ao 

0 65741 

4 

O.08Q26 

0.00285 




8 

0.65812 

0.00071 

4 



16 

0,6575® 

O.0QO16 

4 



32 

0 65746 

0.00005 

3.6 

1,0 

&7wm 

4 

0,75452 

0,00120 




a 

0.75542 

0,00030 

4 



16 

0 75564 

0-00008 

3.75 



62 

0.75570 

0.00002 

4 


9.2.3 Use of Chebyshev Series 

We consider the Fredholm integral equation in the form 


Copyrighted 


Presented By: http://www.ebooksuit.com 



Hidden page 


Presented By: http://www.ebooksuit.com 



Hidden page 


Presented By: http://www.ebooksuit.com 



Hidden page 


Presented By: http://www.ebooksuit.com 



Chapter 9: Numerical Solution of Integral Equations 


9*2*4 The Cubic Spline Method 

We know that in the interval Xj_ t £x£xj,s(x) is given by 

<jc,-jt ) 3 (jc —x ,.,) 3 

s{x) = M- - J — 

w J 1 6h J 6h 


f h 1 \*. - x f h 2 

+ ^-,- T w y , U r+ U J - 7 M J 


(9.33) 


where Mj = yy = y(xj), and ^ + /A, j = 0,1, . N. if we now 

approximate the integral term in (9,17) by using (9.33), we obtain 


n s i 

<)+X J £<*.*) i 


(^-^} 3 _ {ssj- 1) 3 


ft 1 ,, Vj _j f A 2 „ , 

+ "t- + jv-t"/ — t— A 


= /(*A 1-0,1,2. 

Putting j = j' y_j + /tfi, the above equation simplifies to 

>0*) +A X f J i » *H + ^[ M y-l ^ ~ ^ ^ +M ; ~- 


y y ^-— Afy.j (!-/>)+ y>-— 


= /(*,), f = 0, 1,2,.,., AT (9.35) 

In (9.35), the integrals 

i 

J + j p^)/J J ” dp, m s= 0, 1, 2 and 3, (9.36) 

a 

have to be evaluated* This cart be done either analytically (wherever possible) 
or alternatively, by numerical techniques* When these integrals are evaluated, 
Eqs. (9.35) together with, the relations 

6 J 1 3 J 6 ;+l h 


j = U 2, N-l 


(9.37) 


Ma=M N =Q 
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will form a set of (2 N + 2) linear algebraic equations in (2JV + 2) unknowns, 
viz., yt),y\ *■■■,.»> As an example, we consider again 

Love's equation given in the previous example. 

Example 9.7 In contrast with the previous methods, the spline method 
can be applied when the values of d are small. For this particular example, 
the integrals in (9.36) were calculated analytically. Thus for m- 0, we have 



ph)dp 


= lj - i - dp 

* o rf2+ <*i 


Putting jr, st -1 + ih ami j ; _ ( = -14 (J - l)fc, and evaluating the definite integral, 
we obtain 


_ hid _ 

l + fA^Ki-/} (1-7 + 1) 

Similarly we obtain the results 

i 

X\ = J K<x t , sj-i + ph)p dp 

o 


hit 


-l 


_ jL. , 

lx# 


+(i-y+i)jr 0 


t 

| K(x n s M 4 ph) p 2 dp 
0 


jih 


- TT + tf-l + O* 


X a +2X x ((-/+!) 


1 

jr 3 = J K(Xi t sj.j 4 P k)f? dp 

0 


d 

lnh 1 


[5 + 4(/-/)I+ 


3<W+l) 2 






+ (i-i + D 2 



The system of equations was solved by the Gauss-Seidel iteration method 
and a standard subroutine was used for this. The results are summarized in 
the following table for different values of d, and agree closely well with 
those obtained by Phillips [1972], It was found that the method is unsuitable 
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for finding the solution for larger values of if as the convergence is rather 
slow. Thus for J= 1.0 the value obtained with 500 iterations for x = 1.0 is 
0*80692 compared to the true value 0.75572. For more computational results, 
see tiie paper by Sastry [1975]. 

Cubic Spline Solutions of Love's Equation 

y(x) 


jr d^ai d - 0 01 cf — 0 001 * 


0,0 

0 - S 1261 

0.50146 

0.50015 

0 2 

0.51470 

0.50150 

0.50016 

0.4 

0.31858 

0.50107 

0 . 5001 & 

0,0 

0-52870 

0-50261 

0-50026 

O.fl 

0.60608 

0.51713 

0.50271 

1,0 

0,78627 

0.69641 

0.67179 


These results show that the spline method for the numerical solution of 
Fredholm integral equations is potentially useful. Its application to more 
complicated problems will have to be examined together with an estimation 
to error in the method, It seems probable that the condition of continuity 
of the kernel may be relaxed, and the advantage to be achieved by using 
unequal intervals may also be explored. Finally, the solution obtained by the 
spline method can be Improved upon by regarding it as the initial iterate in 
an iterative method of higher order convergence. 

9,3 SINGULAR KERNELS 

If K(sJ) is discontinuous or continuous but badly behaved, the integral 
equation is called a singular integral equaion and the quadrature methods, 
discussed earlier, should not be applied. We may, however, approximate the 
smooth part of the integrand by a simple function and then integrate the 
total new integrand exactly. Such formulae axe called generalised quadrature 
formulae, also called product integration formulae. 

We consider the Integra] equation 

b 

/(*) + J K(x,0 /«)<*=#*>, aSxsb. (9 38 ) 

a 

Ut b-a°nh and i y - a + jh t j - 0,1. n so that t Q = a and t„ = b . Then 

(9.38) can be written as 


n~l */+} 

/«+£ J £(*,()/CO = < 9 J9 > 
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and 


- J-tarf 1 — 
ft* [l + 






pdp 

\+k\i-i-pi 


then 


1 

V?x 


log 


l + A 2 (f-y-]) 2 ' 

i + hHi-jf 




a 9 =h[X0(tj)~Xl(i,j)] and p 9 =hX\(i,j). 
With 151 = 4* we obtain from (9.41) the equations 

1476/0 + 0.126/, + O.081/ 2 + O.OSO/ 3 + 0.01 g/ 4 = 1.0 
G.071/ 0 + 1.153/ +0.l26/ 2 + 0.081/, + 0.029/ = 1.0 
0.047/ +0,126/, + 1 153/2+ 0.126 j^ + 0.047/ = 1.0 


0»029/ o + OSm/i + 0*126/ + 0 <153/ + 0.071/, = 1.0 

0 , 019 / + 0 . 050 / + 0 * 091 / + 0 . 126 / +1 - 076 / ^ 1.0 

The solution of this system, which is centro-symmetric, was obtained on 
a digital computer. The computations were repeated for n = 8, 16 and 32 
and the results, together with the exact values* are tabulated below; 


X 

Exact y(x} 

n 

Computed 

Error 

0.0 

0,65741 

4 

0.65609 

0.06132 



8 

0.65709 

0.0O033 



16 

0-65733 

0.00000 



32 

0.65739 

0.00002 

1.0 

0.75572 

4 

0.75464 

0.00086 



8 

0.755SQ 

0.00022 



16 

0.75566 

0.00006 



32 

0.75570 

0,00002 


Comparison with the results obtained by the ordinary tmp&midai rule 
(see table of results in Example 9.5) shows that this rule gives better 
accuracy than the ordinary trapezoidal rule. The order of convergence is }? 
as in the latter rule. 
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The next example demonstrates the use of generalized quadrature in 
dealing with kernels having a logarithmic singularity. 

Example 9,9 We consider now an example from fluid mechanics involving 
potential flow of an incompressible tnvisdd fluid. 

In many fluid dynamics problems, it is necessary to Calculate the pressure 
distribution on the surface of a body moving in a fluid, For a body of 
revolution in axial flow, Vandrey [1961] derived the linear integral equation 


vfs) = 2x\s) — f A'(j,cr) vfcr) da, Q<,s<.L 
ft J 


(i) 


where 


K(s,a) = 




K(t) 


i /(*- f ) 3 +(> , +'?) 2 

i y Jj 


<M) 


k 2 - 


4 m x >^dx 

(x-tf+iy + T}) 2 ' ~ds 


and K(k) and £(Jt> are complete elliptic integrals of the first and second 
kinds respectively with modulus L In (i), v(i) denotes the velocity distribution 
function on the body surface from which the pressure distribution can be 
found by Bernoulli's equation. Details of the problem and its reduction to 
a system of equations are given in the papers by Kershaw [1971] and Sastry 
[1973, 1976J, where further references may be found. Using the expansions 
of K(k) and E(£) given in Dwight [1934], the kernel Jf(s,cr) in (ii) can be 
split into the form: 

K(s t o-) = P(s, a) log | j - a | + 0«) 

where 


J J (s^) = 


1 

^x-tf + iy + Tj) 2 


Wy-y'jx-4) 2 

\ y % 


-2*1 


xXy-^~yXx-£) 


2 

ft 


imo-Em 


Q(s, a) - K(s, a) - P(s, a) log \s f a\ 


(iv) 
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and 


j.i-t 

1 

When cr = s, it is found that 


P(s t s)=-±~ 

2y 


Qi J, x \^i j °S(^+^' 1 )+^l9i4y 2 +iog4-l 



(v) 


The method of generalized quadrature described in Chapter 5 can now be 
applied to reduce the integral equaion (i) to a system of linear algebraic 
equations. 

The table below gives the numerical results for a cylinder. As the 
solution is centre-symmetric* the results are given only up to s = 90®. The 
computations are made with 20 subdivisions and the accuracy is quite good. 
For the sake of camparison, the accurate value L5 sinr is also tabulated. 
On running the program twice with rt= 10 and n = 20, it was found that 
the order of convergence is two. 


Accurate vsfm 


s (in deg) _ of u^a> Computed value Emr 


ia 

0.4835 

0,4619 

0.0016 

36 

0.6817 

0,6816 

0.0001 

54 

15135 

15141 

0.0006 

72 

1,4266 

1,4275 

0,0009 

90 

1.5000 

1.6011 

0.0011 


For a numerical solution of this problem using Everett T $ formula* see 
Kershaw [1961], 


§.4 METHOD OF INVARIANT IMBEDDING 

This is a method of recent origin, being mainly due to the efforts of Kalaba 
and Ruspini [1969], and is applicable to Fredholm integral equations of the 
second kind 


A 

y (*)- *(*) + J K(x, 1 ) J< 1 ) ds (9.43a) 

0 

where 

«■ 

*{*,») = J /(«)/(**)*<*),& (9.43b) 

0 
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In the method of invariant imbedding, Eq. (9.43) is first rewritten as a 
Volterra intepal equation in the form 

t 

y{x, /) = g(x ) + J K(x , S)y(s,t)d$i 0 & x £ i; 0 £ l £ u. (9,44) 

o 


An essential feature of the method is to convert the Volterra integral equation 
(9,44) into initial-value problems and then solve the initial-value problems by 
any of the standard techniques. The transformation to the Initial-value problems 
involves a series of complicated mathematical manipulations and the interested 
reader is referred to the original paper by Kalaba and Ruspini [1969]. We, 
however, demonstrate its applicability to a practical situation. 


Example 9 . W We consider the problem proposed by Srivastava and Palaiya 
[1969] who have studied the distribution of thermal stresses in a semi- 
infinite solid containing a pennyshaped crack situated parallel to the free 
boundary. The free boundary of the solid is kept at zero temperature and 
in the axisym metric case the problem is reduced to the solution of a Fredholm 
integral equation of the second kind 

y(x) + f K{x, i) j<j) ds= —, (i) 

J £ 



cos £x cos d£ t 


(ii) 


in which y(x) represents the non-dimensionalized stress distribution function 
and the integral equation was derived by assuming that the centre of the 
crack is at the origin; that the solid, which is isotropic and homogeneous, 
is divided into two domains: (i) the layer defined by -H £ z £ 0, and (ii) the 
half-plane 0 £ % £ *?; and that the temperature prescribed on the surface of 
the crack is constant. The derivation and physical details of the problem 
may tie found in the above cited reference where the integral equation was 
solved by the classical iterative method for small values of the ratio of the 
radius of tiie crack to that of its distance from the free boundary, and for 
values of this ratio morer unity, the equation was solved numerically by 
quadrature method. 

For the numerical solution by (he method of invariant Imbedding, the 
radius of the crack is assumed to be of unit length and the integrals are 
approximated by using Gaussian quadrature. Then, the initial-value problems 
become: 
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dt 


N 2 

COS (Mjt}+£ —^F m W(A m )cos(tA m )R /rtk (t) 


x 


cos(£4) + 




^ (iii) 


/^(0) = 0 


and 




g(0+2 


■1 ( l + a m) 


N 




«***+£ -- 


"i OW 

^(0)-o ? os/sr 


(IV) 


where 

*i(0-e(4*0 

and finally, 

jy 

X*.»)-«(*)+ X os^s/si.M 

af*L (1 + 0-) 


In (iii) to (v), fee notation 



is used* a m and F m being the abscissae and weights of fee Appoint Gaussian 
quadrature formula defined! by 


J /(*)*-£ F„f{a m ) 

«~l 


The eqs. (iii) and (tv) have been solved using fee fourth-order Runge-Kutta 
method, and the five-point Gaussian formula. The results are obtained on 
a digital computer and are pven in the following table for different values 
of Hi 
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H 

Jf 


1.06 

0.0 

- 1.7710 


1.0 

- 1.7013 

1J 

0.0 

- 1.7450 


1.0 

- 1.6013 

1.2 

0.0 

-1.6093 


1.0 

- 1.6484 

1.3 

0.0 



1,0 

-18182 

1.6667 

0.0 

- 1.5616 


1,0 

-1.5307 


Although the method produces results which agree quite well with those 
obtained by Srivastava and Palaiya, it suffers with the serious disadvantage 
of being a complicated process and requiring an enormous amount of computing 
time. 

A central idea of the method is to take full advantage of the ability of 
the modem highspeed digital computer to solve systems of ordinary differential 
equations with given initial conditions, and it therefore finds important 
applications in the numerical solution of integral equations occurring in 
radiative transfer, optimal filtering and multiple scattering, 

EXERCISES 


9.1. Verify whether the functions given below are solutions of the integral 
equations indicated against them: 


i 

(a) /(x) = l:/(*)+ 

0 


i 

0 


<c) 


„ , , it x tf 

/(je) = sin-—:/(*)-— 

2 4 




where 



Q£xZt 

t<, x<, 1 
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(d) #*)-*: j (* + ')#(')>* 

& 

(«) /(*) = *-]:/(*)- f(i+r)/(Odr = |*-|. 

0 2 6 

9.2* Solve the following integral equations with degenerate kernels: 
x/A 

(a) /(j)-A J tans/(j)ds=cotj& 

-x/4 

xn 

(b) f(x)-Z | sime coal f(t}dt = sin a* 

0 

X 

(c) f{x) - X J smfx - w) /(a) du = cos jc, 

0 

I 

(d) f(x) ■ sinj+ | [l -jrcos(r/)] 

a 

9*3. Solve the integral equations given in problem 1(d) and (e) by 

(i) the trapezoidal method 

(ii) the cubic spline method 

In each case, divide the range into two equal subintervals and 
approximate to the solution. Compare your results with the exact 
solution. 
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10.1 INTRODUCTION 


In Chapters 7 and 8 we discussed finite difference methods for the solution 
of boundary-value problems defined by ordinary and partial differential equations. 
We now describe another class of methods for the solution of such problems, 
known as th t finite element methods- A full discussion of these methods is 
outside the scope of this book—as normally this does not form part of an 
introductory course on numerical methods. We give here only a brief presentation 
so as to enable the reader to know that such methods exist. The discussion 
includes an elementary formulation of the method with simple applications 
to ordinary and partial differential equations. For details, the reader is referred 
to the excellent book by Reddy [1985]. 

The basic idea behind the finite element method is to replace a continuous 
function by means of piecewise polynomials, Such an approximation, called 
the piecewise polynomial approximation, will be discussed in Section 10,1 ,2* 
The reader is already aware of the importance of polynomial approximations 
in numerical analysis. These are used in the numerical solution of practical 
problems where the exact functions are difficult to obtain or cumbersome 
to use. The idea of piecewise polynomial approximation is also not new to 
the reader, since the cubic spline already discussed, belongs to this class of 
polynomials. 

In engineering applications, several approximate methods of solution are 
used and the reader is familiar with a few of them, e.g. the method of least 
squares, method of collocation, etc. In Section 10,2, we discuss two important 
methods of approximation* viz,, the Rayleigh-Ratz method and the Galerkin 
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technique, Rayleigh developed the method to solve certain vibration problems 
and Ritz provided a mathematical basis for it and also applied it to more 
general problems. Whereas the Rayleigh-Riti method ts based on the existence 
of a functional (see Section 10. LI), the Galerkin technique uses the governing 
equations of the problem and minimizes the error of the approximate solution. 
The latter does not require a functional. A disadvantage of both these 
methods is that higher-order polynomials have to be used to obtain reasonable 
accuracy. 

The finite element method, described in the present chapter, is one of 
the most important numerical applications of the Rayleigh-Ritz and Galerkin 
methods. Its mathematical software is quite popular and used extensively in 
the solution of many practical problems of engineering and applied science. 
In the finite element method,, the domain of integration is subdivided into a 
number of smaller regions called elements and over each of these elements 
die continuous function is approximated by a suitable piecewise polynomial. 
To obtain a better approximation one need not use higher-order polynomials 
but only use a finer subdivision, i.e. increase the number of element, 

in practice, several types of elements are in use, die type used being 
largely dependent upon the geometrical shape of the region under consideration. 
In two-dimensional problems, the elements used are triangles, rectangles 
and quadrilaterals. For three-dimensional problems, tetrabedra, hexahedra 
and parallelepiped elements are used. Since our attempt in this chapter is 
only to introduce the finite element method, we restrict our discussion to 
the use of triangular elements in the solution of simple two-dimensional 
problems (see Section 10.4.2). 

Examples of typical finite elements are shown in Fig. 10. L 



te) Lifts etemsnt (b] Triangular and Quadrilateral elements 

Figure 10.1 

104,1 Functionals 

The concept of a functional is required to understand the Rayleigh-Ritz 
method, which will be discussed in the next section. This concept arises in 
the study Of variational principles, which occur widely in physical and other 
problems. Mathematically, a variational principle consists in determining the 
extreme value of the integral of a typical function, say f{x, y, /). Here the 
integrand is a function of the coordinates and their derivatives and the 
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integration is perforated! over a region. Consider, For example, the integral 
defined by 


b 

*{y)= | /)<&* 


& 


( 10 . 1 ) 


where y(x) satisfies the boundary conditions yfo) - y{£) e 0. 

The integrand / is integrated over the one-dimensional domain x. I is 
said to be a functional and is defined as a function which transforms a 
function y into a real number, the value of the definite integral in (10.1). Front 
calculus of variations we know that a necessary condition for I{y) to have 
an extremum is that X*) must satisfy the Euler-Lagrange differential equation 

ac-ifscU 00 . 2 ). 

dy ) 

Similarly, for functionals of the form 


b 

Ky)= J /(*» y> y\y*)dx 


a 


the Euler-Lagrange equation takes the form 

dy dx*{dy") 


(10.3) 


CIO-4) 


The Euler-Lagrange equation (10.2) has several solutions and the one which 
satisfies the given boundary conditions is selected. Thus, one determines the 
functional so that it takes on an extremum value from a set of permissible 
functions. This is the central problem of a variational principle. An important 
point here is that an extremum may not exist. In other words, a variational 
principle may exist, but an extremum may not exist Furthermore, not all 
differential equations have a variational principle. These difficulties are serious 
and therefore impose limitations on the application of the variational principle 
to the solution of engineering problems. 

Many problems arising in physics and engineering are modelled by 
boundary-value problems and initial boundary-value problems. Frequently, 
these equations are equivalent to the problem of the minimization of a 
functional which can be interpreted in terms of the total energy of the given 
system. In any physical situation, therefore, die functional is obtained from 
a consideration of the total energy explicitly. Mathematically, however, it 
would be useful to be able to determine the functional from the governing 
differential equation itself. This is illustrated below with an example. 


♦For example, see Sastiy [1997, a], 
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Example I&d Find the functional for the boundary-va] ue problem defined by 

d 2 y 

(i) 


>M = y(6)=0. 


We have 


£ J fyx^j f5ydx 


Hence 


-} sin “ 

- f — — (<5 y)dx, on integrating by parts 
Ldx } a ^ dx dx 

b 

■-f ^ — 0y)dx.sinceSy(a)*zSy(b)^0 
* dx dx 
a 

-/ *'(*}*■ s®'>'*(£) 

-ftfST* 


*/[** 5 (S] ]*•* 


It follows that a unique solution of the problem (i) to (ii) exists at a 
minimum value of the integral defined by 


/W= J. [> + 2[Sj J* 
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By definition, therefore, the integral in (iii) represents the required functional 
of the problem. In a similar way, functionals of otter boundary-value and initial 
boundary-value problems can be derived, 

It is outside the scop of this book to deal extensively with the determination 
of functionals corresponding to boundary-value problems. We list below 
some familiar boundary-value problems with their associated functionals 
and these would be useful in understanding the problems discussed in this 
chapter 


<9 =/«. Xfl) = H6)=0 

dx 

b 

m= J v(z/-v")*. 

1 1 

00 ^ + = 0 <*<l;/< 0 } = 0 , f^l =1 

a 2 

/(v)»- f[f —1 -*v I + 2 w :! 1 a-v( 1 ). 

2 JIW J 

(iii) *V' + 2xy' - /(r), y(aY = y(b) = 0 

/('•)= J v[ 

(iv> V 2 u~ 0 t w = 0 on the boundary C of R< 


m - ff 1 ^-T+f- 

' 2 larj ^ 


cfxify. 


(v) y 2 ifs-/ ( a = Q on the boundary C of R, 


if &u'] 2 fdvV 1 .1 . , 

— + -r- \-uf\dx<fy. 

\3x) I 


^y 


(vi) E/^ + ky = /(x) f 0<x<l 
dx 


/(v) = IJ 


d l y 

y = O-^-f at jc®0, i 
dx 1 

{ ,2 \ 2 


tie, 


(10.5) 

( 10 . 6 ) 

(10.7) 

( 10 . 8 ) 

(10.9) 

( 10 . 10 ) 

(10.11) 

( 10 . 12 ) 

(1013) 

(10.14) 

(10.15) 

(10.16) 
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Then eq, (v) becomes 

a n n 

/(v)=-2^ J^apjtg 

i=1 /.| 

Hence dHda f = 0 fives 



(f*1. X -^nl 


(viii) 


We wish to find an approximate solution with n-2 and we therefore choose 
$(*) = *([-*) and ^ 2 (x)-x 1 (l-x) t so that the boundary conditions (iv) 
are satisfied. 

Now, from (vi), we have 

p, = JV(1 -x)dx = ± 

D 

and 



20 * 


* 

Also, ^J(jc) = 1 — 2jc and = 2x- 3x . Equation fvii) gives 


, ll =-J(l-2* 2 ) I fc = -I 

o J 

■?I 2 *-j (1 - 2x) (2x - lx 1 ) dx - q 1Xi by symmetry 


?£> = 



Equations (viii) now give 

Aa x + 2a 2 -\ and 10« 6 +%a 2 = 3* 
whose solution is -a 2 - 1/6. Hence 

V« = + ii(1 -* 1 ). 

It can be verified that this is the exact solution of the problem (i}> 
Example I&,3 Solve the boundary-value problem defined by 

y" + y = -x, 0 < jr cl (i) 
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with 

J'(0) = J'(1)=0 (ii) 

The exact solution of the problem (i) and (ii) is given by 

**)=*“*. (iii) 

sin! 

To find the approximate solution by the Rayleigh-Rife method, we take the 
functional in the form 


/(v) - J (w"+ v 2 + 2vx) dx. 


Civ) 


Let an approximate solution be given by 

n 

i=t 

where 

^(C)-^(l) = 0 for all i. 
Substituting for v in (hr), we obtain 


(v) 


(vi) 


= \ Ti X Z **<*) Z At»)+ 2 » 2 w 

0 |_/-l j-i j-i J-t t=\ 


/(v)= 


As in the previous example, we let 


1 


Pi = J MW* 


dr 

(vii) 


(viii) 


and 


Further, let 


i J 

» f <fr) 


- J *00#, w*. 


Equation (vii) now becomes 
n n 


/{v) = El “(“/»!/ + X X a Pfv + 2 E 

/=! j~\ 1=5 ; = l i = i 


(*) 


(xi) 
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The approximate solution is given by 

m 13 1 7 

v 1 -- x + - x, 

12 4 

The student should compare this with the exact solution, 

10,2,2 Th© Galerkin Method 

The Rayleigh-Ritz method discussed in Section 10,2.1 Is a powerful technique 
for the solution of boundary-value problems. It has, however, the disadvantage 
of requiring the existence of a functional which is not always possible to 
obtain. In fact, not all differential equations have a variational principle. 
Most engineering problems are expressed in terms of certain governing 
equations and boundary conditions, and not in terms of a functional. Galer kin’s 
method belongs to a wider class of methods called the weighted residual 
methods. In this method, an approximating function called the trial function 
(which satisfies all the boundary conditions) is substituted in the given 
differential equation and the result is called the residual (the result will not 
be zero since we have substituted an approximating function). The residual 
is then weighted and the integral of the product, taken over the domain, is 
then set to zero, It can be shown that if the Euler-Lagrange equation 
corresponding to a functional coincides with the differential equation of the 
problem, then both the Rayleigh-Riu and Galertin methods yield the same 
system of equations. 

To explain Galerkin's method, we consider the boundary value problem 
defined by 

/ , + p{x))/ + q(x)y=f(x) t a<x<b (10,27) 

with the boundary conditions 

wW+wW-tl (l02g) 

To find an approximate solution of the problems (10.27) and (10.28), we 
choose base functions ^(jr) as in the Rayleigh-Ritz method. 

Then an approximate solution v(x) is assumed to be a linear combination 
of the fa Le. v(jr) is written as 


K*) = Xa,4(*). (10.29) 

r-l 

Now, v(x ) will not, in general, satisfy (10.27), but produces a residual or 
discrepancy. This is equal to the difference between the left-hand and right- 
hand sides of Eq, (10.27) when on the left side y(x) is replaced by v(jc). If 
M?) is the residual, we then write 

j?(v) - v" + p(x)v‘ + q(x)v - f{x). (10,30) 
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Taking the weight function as y/,(x), we write 

t 

f W (*)/8(v)A = 0, (10.31) 

a 

which yields a system of equations for the unknown parameters a i and can 
be solved, in Gal erk in's method, we usually take = $,(*). The method 
is illustrated with the following example: 

Example MS We consider again the problem of Example J03* viz,, 

y" + y=-x t 0 < x < I (i) 

m = H 0-0 (it) 

As our first approximation, we choose 

K*) = «i#lW = ai*(l-*X (ii>) 

where ^ l (0)=#,{l) = a 

Substituting for v in (i), we obtain 

R(v) - v” + v + x (iv) 

Hence, using (10.31), we write 

i 

J {v" + v + x) 4] (x) dx - 0 
o 

L 

J(v" + v+i)i(l-i)ii = 0 (v) 

0 

Now, 

1 I I 

jVx(l-x)<fc = [v'aa-*)]o“ Jv'd-lr)*"-jv'(l-2*)de, 
o oo 

since the first expression on the right vanishes. Now, 
l 1 1 

J v"x(l-*>«fc=-[v(t-2*)]{,- J - 2v <£r = -2 J v<*. since v(0)=v(l)=0. 
o a o 

Hence (v) becomes 

] 

J [~2v + vKa-*)+Jc 2 <l-je)l(i* = 0, (vi) 

0 

which gives on simplification = 5/1S “ 0.2778. (vli) 
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be a first approximation to «. Clearly, v satisfies the boundary conditions, 
i.c. v = 0 on the boundary C. The derivatives are given by 


= ay (y -1) (2x - 1); ^ = ax{x -1) (2 y- 1); 

rar ay 


d*v 

— ^2ay(y~l); 


—r = 2 «jt(x- l). 
By 1 


<iv) 


Substituting for v in (ii), we obtain 

1 1 

f(v)= J ( v ) 


o o 


Let 


0 0 
L 1 

6= f jVU-OCy-i) 1 *■*=--— 

a o 180 

1 1 


0 0 

Equation (v) now simplifies to 

/(v) = TJtma - 2a 2 b - 2a 2 c. 

Hence 

— =0= 2ka - 4ah-4a& 
da 


(vi) 


Thus 


a-- 


ak 


— = using (vi). 


2(* + c) 

It follows that the required approximation for u is given by 
u»v = -^fay(x-l)(y-l). 

The student should verity that the Galerkin method gives the same solution 
as above. 

10.4 THE FINITE ELEMENT METHOD 

The Rayleigb-lltz and Galerkin methods, discussed in the previous sections, 
cannot be applied directly for obtaining the global approximate solutions of 
engineering problems. An important reason for this is the difficulty associated 


/riqht 
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Instead of Bq. (\QAQ\ we now have 


KtoyW a fW (10,50) 

where K\p and are given by (10.41) and (10,42). 

With the choice of (jc) as in Eq. (10.48), we now demonstrate the 
computation of and F |ei , In particular, we choose i and / = 2, 

With h e -x t we obtain 


where 


^ = _± and 
dx h f dx h e 


(10,51) 



and 


F, (tl = 2 


| ^ dx+D ^=h e + Dl 


to 


%-t 


fj W -2 f - <ic+D < 1 t) ~h, + D^ i . 

* h. 


*-l 

As a particular case, we consider the following example* 
Example 1&? We consider die following problem defined by 

^ = -2, 0<*<L, y<0) = 0, ]/(l) = 0. 

The exact solution of the above problem is given by 

>(x) = 2x~j? 

Comparison with (10.32) shows that a{ jc)= 1 and f(x} = 2. 


(10,53) 


(i) 


O') 


^opy Tighten 
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(a) To demonstrate the steps involved in the finite element solution, we 
divide [0, l] into two equal subintervab with h e =1/2. From (10.41) and 
(10,49), we obtain the equations for both elements. 


0) e=*h x+_t =0* jf * =1/2* 


i + n0> 

2 1 


(h) e-2: ■ 1/2, x t - 1 


K™ = 






Having determ ined the equations for each element these have to be assembled 
now to determine the global approximations. This will be the next step in 
the finite element solution. 

Step 4 {Assembly of element equations): We shall explain this step with 
reference to the two elements obtained in Example 10.7. In this case, the 
two elements are connected at the node 2, Since tie fimetiQftytx) is contuiwotts, 
it follows titat of element 1 should be the same as y, of element 2. For 
the two elements of Example 10,7, the correspondence can be expressed 
mathematically as follows: 

>?>=*. 

In the finite element analysis, such relations are usually called interelement 
continuity conditions. 

Using the above relations, the global finite element model of the given 
boundary value problem is 

\ 2 -2 Of Hi r V2 + dP 1 


l 0 -2 2j[ I'd [ V2 *Djp \ 

The next step Is the imposition of boundary conditions. 

Step S (Imposition of boundary conditions): The homogeneous boundary 
condition gives Y\ -0* Then, we obtain the equations: 


4r 2 -2F 3 - I, 




since and cancel each other and i>| 2J = 0 is the natural boundary 
condition. The solution of this system is given by 


Presented By: http://www.ebooksuit.com 




Hidden page 


Presented By: http://www.ebooksuit.com 



410 


Chapter 10: The Finite Element Method 




By boundary condition, we have }\ =0. 
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To find the variational form of Eq. (10,54), we multiply it with the test 
function v(x, y) and integrate the result over a typical element J? f5 to obtain 


(i “> 


where 


&u 


dtt 




tj x and rjy being the direction cosines of a unit normal ft on the boundary 
c t and elf is an arc length of an Infinitesimal element along the boundary. 

The next step in the finite element solution of this problem is to set up 
a finite element model of the given equation. To do this, we approximate u 
by the expression 


(10-57) 

/=! 

where Uj - u{xj t y^ and the have the property 


f l if i = j 

Substituting (10,57) in (10*56) and putting v = ^, we obtain 

°-£. ^■) u / <hd y -If J a«»* no-s?) 

for i * I, 2 , 

Equation (I0J9) can be written in the form 


£ «<«>«<*> =/■<*> (10.60) 
/»! 

where 

and 

ri*’ = J J /A dx <fy+ J q„ A *. (10.62) 

K, C. 

Equation (10*60) represents the finite element model of the Poisson equation. 
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We next consider a triangular element (see Fig* 10.3) in which the 
nodes are numbered In the counter-clockwise direction and derive the 
interpolation functions for it We assume the interpolating polynomial in 
such a way that the number of terms in it equals the number of nodes in 
the triangular element. Accordingly, we assume 

w(* T /) = 0i +^x + fljy (10.63) 



as the required approximation. We also set 

>t) - u i> * = 1 P 2, 3 (10*64) 

where (x it y { )> i- h 2, 3 denote the three vertices of the triangle. Substituting 
(10.64) in (10,63), we obtain 


s 0|+Vi+^/i 
1*2 =01 + 02 * 2 + 03/2 ' 


Solving Iqs* (10.65), we obtain 


o,= 




1 

2A, 


2A t 


Oi -- 


2A, 


U \ 

u 2 

»3 


X| 

x 2 

*3 


n 

y% 

y3 


Ui 

\ u 2 



yi 

y% 

n 


i 

i 

i 


u, 

«j 

w 3 


1 

i 

1 

p 

*1 


** 



where 


A tf * Area of the triangle = - 

4 


*1 

*2 


y\ 

yi 

Fj 


(10.65) 


( 10 . 66 ) 


(10,67) 
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Substituting for a u m (10,63) and simplifying, we obtain 

v { x , y ) -— ["1(^2^ - *3^2)+“2(^3 y \ - *\ r?)+ u A x tyi - *2^)1 

2d, 

+[wi iyi - jo)+ “2 Ch - yi)+ ^(yi - yi )1* 

2A e 

+ T7* W *3 - x 2 ) + Vz(xi - JCj) + U}(x 2 ~ (10,6s) 

2d, 

Collecting the coefficients of iq, u 2 and u y in the above, Eq. (10.68) can 
be written in the form 




(10.69) 




where the f* 5 are the linear ittterpolatiitg functions for the triangular elements 
under consideration, and are given by 


1?<*i 0 -^- 


J_ 

2d e 

2 

2A e 

1 


2d, 


x 

*2 

x 3 

X 

X 

X] 

*2 


y 

yi 

n 

y 

yt 

y 

ft 

yi 


From formulae (10.70), it is easily verified that 


(10.70) 


! WJj a » d t W'W)-i o°- 71 ) 


We also have 


0#, w _ 

>2 


ii 

£ 

i 

£ 

& 

2i ( ' 

dy 

2d, 

atf». 

.21121 


e *i~*3 

dx 

2A, ’ 

sy 

2i. 

atf> _ 


d*? 

_ a.-- 1 ! 

& 

2A. ’ 

dy 

2d, ■ 


(10.72) 
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Using Eqs. (10.72) the dement matrices and in (lO + 60) can then 
be computed easily. These computations will be demonstrated through a 
simple example. 

Example 10.8 We consider a particular case of the problem defined by 
Eqs. (10.54) and {I0*55) p viz,* the Poisson equation 

0s * ,ys3 ' <0 

with the condition 

«-0 (ii) 

on the boundary of the square 0£x£l* 0£y£L 

We divide the square region along the line of symmetry x = y and then 
consider only the lower-triangular part. We again subdivide the lower triangular 
part into four triangular elements h as shown in Fig. 10.4. Let the elements 
be numbered, as shown in the figure, and it is seen that element -CD, © and 
® are symmetrical. Hence the element matrices for these dements will all 
be of the same type. 



Figure 10.4 

Now, the vertices l, 2 and 3 of the dement © are given by (0,0), (1/2,0) 
and (1/2, 1/2) respectively. For this element, we obtain Aj = 1/S and 
Eqs. (10,70) give 
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It is easy to see that + #2 * + + 3 * - ^ thus verifying (10,71), The element 
matrices K and F can now be computed easily, using (10,61} and (10,62). 
We first obtain the derivatives 


/V,® , 

*P» 

a* = ~ % 

ay 

**? , 

a *£ 

at ^ 

3v 

d 4- 0 . 

Bjl 

&X 

dy 


-0 


i-2 


= 2 


(iv) 


Equation {10,61} now gives 

*ff-f f 4dxdy-± K$>= = JCg’-O 




i jrO>_i i 

A ii - 2' 2 

r cu-o ^a> _ 1 

a 31 -w, A 31 " 2 1 33 _ 2 

Similarly Eq. ( 10 . 62 ) yields 

F,< l) = J J 2(1-2*)*#+ | 9»(1-2*)<6 

*133 QlJ 


(V) 


02 l« 

= J | 2(]-2*)&^+(,®.say 

0 0 


where/» - f 
Cm 


F® = / J 2(2*-2>.)*4’+ J J.(2x-2y)A 

*m c m 

= ^ +/ t where ■ J q„ (2* - 2y) ds 
n c m 

F? - J | 4 ydxdy* J q n { 2 y)ds 
*123 Cm 

= ^+/, a) . where/®* j q„(2y)ds 
“ C m 
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Let the global nodes be U lt U 2 > U& U A , U$, and U 6 corresponding to the 
local nodes u lP u 2 , a 4p u 5 and u b at the respective vertices. As there are 
six nodes* the corresponding matrices will be of order 6. Hence, we obtain 
for element ®: 



' 1/2 

-1/2 

0 

0 

0 

0 " 


~l 


If*' 


-1/2 

1 

-1/2 

0 

0 

0 


l 


tf 

£ fl3 = 

0 

-1/2 

1/2 

0 

0 

8 

and J?® = - 

l 


/?> 







+ 

*3 

0 

0 

0 

0 

0 

0 

12 

0 


0 


i ° 

0 

0 

8 

0 

8 


0 


0 


0 

0 

8 

0 

0 

0 


0 

1 

0 


(vii) 

Since the elements ® and <3> are similar to ©, their element matrices will 
be of the same type as those of $ given in (vii). Thus, for element 



0 

0 

0 

0 

0 

0 ’ 


"0 ' 


0 


8 

1/2 

8 

-1/2 

0 

0 


I 


*1 

K™ = 

0 

0 

0 

0 

0 

0 

and fW-1 

0 

+ 

0 


0 

-1/2 

0 

l 

-1/2 

0 

12 

1 


if 


0 

0 

0 

-1/2 

1/2 

0 


I 


If 


.0 

0 

0 

8 

8 

0 . 


0 


0 . 


(viii) 

Similarly, for element 




0 

0 

0 

0 

0 

0 


0 ' 


"0 

0 

0 

0 

0 

0 

0 


0 


0 








1 


/{*> 

0 

0 

1/2 

0 

- 1/2 

0 

and 


+ 


0 

0 

8 

8 

8 

8 

* 12 

0 


8 








1 


IP 

0 

0 

- 1/2 

0 

l 

- 1/2 




0 

0 

0 

8 

- 1/2 

1/2 1 


1 




<ix) 

Finally, for element 0, we note that the correspondence between its vertices 
and those of 0 is given by S -*1,3—► 2, and 2-* 3. Hence, we have 
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OOO 
0 1/2 - 1/2 
0 - 1/2 1 


0 0 


0 -1/2 O 


O O -1/2 0 1/2 0 


and + 

12 0 O 


0 0 


Assembling the element matrices in (vii) T (viii), (ix) and 00 aod simplifying, 
we obtain the matrix equation 


1 -1 


0 -1 


2 0 -l 


0 01 


-2 -I 


-1 U< 


111 U< 


From the boundary conditions, we toe (see Fig, 10.4) 


Hence, eq. (xi) gives 


Ut -Ui^Ua-U* 


-u 3 +/«+/<')+/«) 

4 

+ /« 4 > 


From (xiv), we obtain 






/?»+/| 4 > 
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10 - 3 - i 3 ^£+2*^ = *<*), y(0) = ><])=0. 

dx 2 dx 

10.4. ±2. + p(x)y + ,(,)= 0 , y(a) = y(b) = 0 . 

10 . 5 . tLZ.+ky-f{x), 0<x<\, y = ^ll=:Q mx=0,{. 

dx 4 fir 

iy, V 2 «-0, v “0 on the boundary C of R. 

10,7, « = 0 on the boundary C of R, 

Use the Rayleigh-Ritz method to solve the following boundary-value problems 
{Problems 8—11): 
d 2 

+ 2x = 0, ><0) = MO = & 
d 2 y j 

10.9. —-j + y = x\ y(0) - MO - 0 (Use a two-parameter approximate 
dx 

solution). 

10.10, —¥• + j£«fe + y - 2x, M0) = 1 and M0 “ 0. 
dx 2 dx 

tan. + x ^--2y-0, M(0) + M0) = 1 and Ml) - 2, 

dx dx 


Compare the two-parameter approximate solution with the analytical solution 
given by y = x 2 + l, Apply the Galerkin technique to solve the following 
boundary-value problems (Problems 12-14): 

10,12, Exercise 9 above. 

1043, Exercise 11 above. 


,014 - > , (0)=o, y<i)=“ 

dx & 

10.15. Using Galerkin technique, solve Poisson's equation 


d 2 u &*u 


0<i, y < 1 


with u = 0 on the boundary C of die region R. 

1046. Use the Galerkin technique to approximate Eq, (10.36) and hence 
obtain the solution of the boundary-value problem defined by 

d 2 y 

^j—2, o<x<h M0)=o, 
taking two equal subintervals. 
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10.17, In the notation of Example 10 8, prove that (a) - 0 (b) /[** - 0. 

10J8. (Reddy), Solve Poisson’s equation 




0<jt f y<l 


where 



1 /( 1 , y)*u(x> 1 ) = 0 . 
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